Started by user sanjit [EnvInject] - Loading node environment variables. Building remotely on slv-s23201 (P0 jython_slave PY3P0) in workspace /data/workspace/Sanjit_jython_temp [WS-CLEANUP] Deleting project workspace... Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/couchbaselabs/TAF.git > /usr/bin/git init /data/workspace/Sanjit_jython_temp # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git --version # timeout=10 > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 > /usr/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 Checking out Revision eed52e710de3f5df7de482c39c7c0512b47d1761 (origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 > /usr/bin/git checkout -f eed52e710de3f5df7de482c39c7c0512b47d1761 > /usr/bin/git rev-list eed52e710de3f5df7de482c39c7c0512b47d1761 # timeout=10 > /usr/bin/git tag -a -f -m Jenkins Build #614 jenkins-Sanjit_jython_temp-614 # timeout=10 No emails were triggered. [Sanjit_jython_temp] $ /bin/sh -xe /tmp/jenkins4324422350908274549.sh + echo ' [global] username:root password:couchbase index_port:9102 n1ql_port:8093 data_path:/data/kv [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:172.23.105.223 port:8091 services:kv [_2] ip:172.23.105.221 port:8091 services:kv,n1ql,index [_3] ip:172.23.105.220 port:8091 services:kv,n1ql,index [_4] ip:172.23.105.208 port:8091 services:kv,n1ql,index [_5] ip:172.23.105.226 port:8091 services:kv,n1ql,index [_6] ip:172.23.105.227 port:8091 services:kv,n1ql,index [_7] ip:172.23.105.225 port:8091 services:kv,n1ql,index #[_7] #ip:172.23.105.220 #port:8091 #services:kv #[_6] #ip:172.23.105.223 #port:8091 #services:kv ' [Sanjit_jython_temp] $ /bin/sh -xe /tmp/jenkins4687323576880623425.sh + echo version=7.1.0-1695 version=7.1.0-1695 + echo version=7.1.0-1695 version=7.1.0-1695 + mkdir tr_for_install + cd tr_for_install + git clone https://github.com/couchbase/testrunner.git Cloning into 'testrunner'... Checking out files: 10% (334/3106) Checking out files: 11% (342/3106) Checking out files: 12% (373/3106) Checking out files: 13% (404/3106) Checking out files: 14% (435/3106) Checking out files: 15% (466/3106) Checking out files: 16% (497/3106) Checking out files: 17% (529/3106) Checking out files: 18% (560/3106) Checking out files: 19% (591/3106) Checking out files: 20% (622/3106) Checking out files: 21% (653/3106) Checking out files: 22% (684/3106) Checking out files: 23% (715/3106) Checking out files: 24% (746/3106) Checking out files: 25% (777/3106) Checking out files: 26% (808/3106) Checking out files: 27% (839/3106) Checking out files: 28% (870/3106) Checking out files: 29% (901/3106) Checking out files: 30% (932/3106) Checking out files: 31% (963/3106) Checking out files: 32% (994/3106) Checking out files: 33% (1025/3106) Checking out files: 34% (1057/3106) Checking out files: 35% (1088/3106) Checking out files: 36% (1119/3106) Checking out files: 37% (1150/3106) Checking out files: 38% (1181/3106) Checking out files: 39% (1212/3106) Checking out files: 40% (1243/3106) Checking out files: 41% (1274/3106) Checking out files: 42% (1305/3106) Checking out files: 43% (1336/3106) Checking out files: 44% (1367/3106) Checking out files: 45% (1398/3106) Checking out files: 46% (1429/3106) Checking out files: 47% (1460/3106) Checking out files: 48% (1491/3106) Checking out files: 49% (1522/3106) Checking out files: 50% (1553/3106) Checking out files: 51% (1585/3106) Checking out files: 52% (1616/3106) Checking out files: 53% (1647/3106) Checking out files: 54% (1678/3106) Checking out files: 55% (1709/3106) Checking out files: 56% (1740/3106) Checking out files: 57% (1771/3106) Checking out files: 58% (1802/3106) Checking out files: 59% (1833/3106) Checking out files: 60% (1864/3106) Checking out files: 61% (1895/3106) Checking out files: 62% (1926/3106) Checking out files: 63% (1957/3106) Checking out files: 64% (1988/3106) Checking out files: 65% (2019/3106) Checking out files: 66% (2050/3106) Checking out files: 67% (2082/3106) Checking out files: 68% (2113/3106) Checking out files: 69% (2144/3106) Checking out files: 70% (2175/3106) Checking out files: 71% (2206/3106) Checking out files: 72% (2237/3106) Checking out files: 73% (2268/3106) Checking out files: 74% (2299/3106) Checking out files: 75% (2330/3106) Checking out files: 76% (2361/3106) Checking out files: 77% (2392/3106) Checking out files: 78% (2423/3106) Checking out files: 79% (2454/3106) Checking out files: 80% (2485/3106) Checking out files: 81% (2516/3106) Checking out files: 82% (2547/3106) Checking out files: 83% (2578/3106) Checking out files: 84% (2610/3106) Checking out files: 85% (2641/3106) Checking out files: 86% (2672/3106) Checking out files: 87% (2703/3106) Checking out files: 88% (2734/3106) Checking out files: 89% (2765/3106) Checking out files: 90% (2796/3106) Checking out files: 91% (2827/3106) Checking out files: 92% (2858/3106) Checking out files: 93% (2889/3106) Checking out files: 94% (2920/3106) Checking out files: 95% (2951/3106) Checking out files: 96% (2982/3106) Checking out files: 97% (3013/3106) Checking out files: 98% (3044/3106) Checking out files: 99% (3075/3106) Checking out files: 100% (3106/3106) Checking out files: 100% (3106/3106), done. + cd testrunner + git checkout master Already on 'master' + git pull origin master From https://github.com/couchbase/testrunner * branch master -> FETCH_HEAD Already up-to-date. + py_executable=python + echo 7.1.0-1695 + grep '7\.' 7.1.0-1695 + py_executable=python3 + python3 scripts/new_install.py -i /tmp/sanjit.ini -p timeout=1200,get-cbcollect-info=True,version=7.1.0-1695,product=cb,debug_logs=False,url= 2021-11-21 22:51:21,875 - root - WARNING - URL: is not valid, will use version to locate build 2021-11-21 22:51:21,878 - root - INFO - SSH Connecting to 172.23.105.223 with username:root, attempt#1 of 5 2021-11-21 22:51:22,038 - root - INFO - SSH Connected to 172.23.105.223 as root 2021-11-21 22:51:22,398 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:22,835 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:22,839 - root - INFO - SSH Connecting to 172.23.105.221 with username:root, attempt#1 of 5 2021-11-21 22:51:23,048 - root - INFO - SSH Connected to 172.23.105.221 as root 2021-11-21 22:51:23,442 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:23,891 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:23,896 - root - INFO - SSH Connecting to 172.23.105.220 with username:root, attempt#1 of 5 2021-11-21 22:51:24,056 - root - INFO - SSH Connected to 172.23.105.220 as root 2021-11-21 22:51:24,428 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:24,875 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:24,880 - root - INFO - SSH Connecting to 172.23.105.208 with username:root, attempt#1 of 5 2021-11-21 22:51:25,060 - root - INFO - SSH Connected to 172.23.105.208 as root 2021-11-21 22:51:25,476 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:25,898 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:25,904 - root - INFO - SSH Connecting to 172.23.105.226 with username:root, attempt#1 of 5 2021-11-21 22:51:26,078 - root - INFO - SSH Connected to 172.23.105.226 as root 2021-11-21 22:51:26,475 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:26,930 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:26,935 - root - INFO - SSH Connecting to 172.23.105.227 with username:root, attempt#1 of 5 2021-11-21 22:51:27,097 - root - INFO - SSH Connected to 172.23.105.227 as root 2021-11-21 22:51:27,488 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:27,934 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:27,939 - root - INFO - SSH Connecting to 172.23.105.223 with username:root, attempt#1 of 5 2021-11-21 22:51:28,107 - root - INFO - SSH Connected to 172.23.105.223 as root 2021-11-21 22:51:28,455 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:28,898 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:28,903 - root - INFO - SSH Connecting to 172.23.105.221 with username:root, attempt#1 of 5 2021-11-21 22:51:29,073 - root - INFO - SSH Connected to 172.23.105.221 as root 2021-11-21 22:51:29,451 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:29,916 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:29,920 - root - INFO - SSH Connecting to 172.23.105.220 with username:root, attempt#1 of 5 2021-11-21 22:51:30,086 - root - INFO - SSH Connected to 172.23.105.220 as root 2021-11-21 22:51:30,463 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:30,905 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:30,910 - root - INFO - SSH Connecting to 172.23.105.208 with username:root, attempt#1 of 5 2021-11-21 22:51:31,082 - root - INFO - SSH Connected to 172.23.105.208 as root 2021-11-21 22:51:31,463 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:31,912 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:31,918 - root - INFO - SSH Connecting to 172.23.105.226 with username:root, attempt#1 of 5 2021-11-21 22:51:32,089 - root - INFO - SSH Connected to 172.23.105.226 as root 2021-11-21 22:51:32,471 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:32,909 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:32,914 - root - INFO - SSH Connecting to 172.23.105.227 with username:root, attempt#1 of 5 2021-11-21 22:51:33,072 - root - INFO - SSH Connected to 172.23.105.227 as root 2021-11-21 22:51:33,415 - root - INFO - os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:51:33,844 - root - INFO - extract_remote_info-->distribution_type: CentOS, distribution_version: centos 7 2021-11-21 22:51:33,846 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,950 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:33,950 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,953 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:33,953 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,956 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:33,956 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,958 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:33,959 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,961 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:33,962 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:33,964 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/1695/couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm is live 2021-11-21 22:51:44,896 - root - INFO - Done with uninstall on 172.23.105.220. 2021-11-21 22:51:44,950 - root - INFO - Done with uninstall on 172.23.105.226. 2021-11-21 22:51:45,263 - root - INFO - Done with uninstall on 172.23.105.227. 2021-11-21 22:51:45,366 - root - INFO - Done with uninstall on 172.23.105.221. 2021-11-21 22:51:52,497 - root - INFO - Done with uninstall on 172.23.105.208. 2021-11-21 22:51:53,474 - root - INFO - Done with uninstall on 172.23.105.223. 2021-11-21 22:51:55,715 - root - INFO - running command.raw on 172.23.105.223: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:55,744 - root - INFO - command executed successfully with root 2021-11-21 22:51:57,460 - root - INFO - running command.raw on 172.23.105.221: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:57,493 - root - INFO - command executed successfully with root 2021-11-21 22:51:58,845 - root - INFO - running command.raw on 172.23.105.220: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:51:58,886 - root - INFO - command executed successfully with root 2021-11-21 22:52:00,305 - root - INFO - running command.raw on 172.23.105.208: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:52:00,334 - root - INFO - command executed successfully with root 2021-11-21 22:52:01,672 - root - INFO - running command.raw on 172.23.105.226: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:52:01,704 - root - INFO - command executed successfully with root 2021-11-21 22:52:03,086 - root - INFO - running command.raw on 172.23.105.227: cd /tmp/ && wc -c couchbase-server-enterprise-7.1.0-1695-centos7.x86_64.rpm 2021-11-21 22:52:03,118 - root - INFO - command executed successfully with root 2021-11-21 22:53:15,590 - root - INFO - Done with install on 172.23.105.223. 2021-11-21 22:53:15,591 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:15,593 - root - ERROR - socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:16,106 - root - INFO - Done with install on 172.23.105.208. 2021-11-21 22:53:16,107 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:16,109 - root - ERROR - socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:16,512 - root - INFO - Done with install on 172.23.105.227. 2021-11-21 22:53:16,513 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:16,515 - root - ERROR - socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:18,108 - root - INFO - Done with install on 172.23.105.221. 2021-11-21 22:53:18,110 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:18,111 - root - ERROR - socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:18,596 - root - ERROR - socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:19,114 - root - ERROR - socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:19,521 - root - ERROR - socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:21,120 - root - ERROR - socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:21,853 - root - INFO - Done with install on 172.23.105.226. 2021-11-21 22:53:21,854 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:21,856 - root - ERROR - socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:24,605 - root - ERROR - socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:24,860 - root - ERROR - socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:25,119 - root - ERROR - socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:25,523 - root - ERROR - socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:27,129 - root - ERROR - socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:29,981 - root - INFO - Done with install on 172.23.105.220. 2021-11-21 22:53:29,982 - root - INFO - Waiting for couchbase to be reachable 2021-11-21 22:53:29,985 - root - ERROR - socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:30,868 - root - ERROR - socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:32,991 - root - ERROR - socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:36,628 - root - INFO - running command.raw on 172.23.105.223: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.223 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:37,143 - root - INFO - running command.raw on 172.23.105.208: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.208 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:37,158 - root - INFO - command executed successfully with root 2021-11-21 22:53:37,177 - root - INFO - running command.raw on 172.23.105.223: rm -rf /data/kv/* 2021-11-21 22:53:37,546 - root - INFO - running command.raw on 172.23.105.227: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.227 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:37,703 - root - INFO - command executed successfully with root 2021-11-21 22:53:37,711 - root - INFO - running command.raw on 172.23.105.208: rm -rf /data/kv/* 2021-11-21 22:53:38,372 - root - INFO - command executed successfully with root 2021-11-21 22:53:38,379 - root - INFO - running command.raw on 172.23.105.227: rm -rf /data/kv/* 2021-11-21 22:53:38,407 - root - INFO - command executed successfully with root 2021-11-21 22:53:38,409 - root - INFO - running command.raw on 172.23.105.227: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:38,481 - root - INFO - command executed successfully with root 2021-11-21 22:53:38,482 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:39,001 - root - ERROR - socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:53:39,149 - root - INFO - running command.raw on 172.23.105.221: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.221 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:39,728 - root - INFO - command executed successfully with root 2021-11-21 22:53:39,736 - root - INFO - running command.raw on 172.23.105.221: rm -rf /data/kv/* 2021-11-21 22:53:39,839 - root - INFO - command executed successfully with root 2021-11-21 22:53:39,840 - root - INFO - running command.raw on 172.23.105.221: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:39,874 - root - INFO - command executed successfully with root 2021-11-21 22:53:39,876 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:41,498 - root - INFO - command executed successfully with root 2021-11-21 22:53:41,499 - root - INFO - running command.raw on 172.23.105.223: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:41,571 - root - INFO - command executed successfully with root 2021-11-21 22:53:41,571 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:41,763 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:42,775 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.227 2021-11-21 22:53:42,775 - root - INFO - pools/default params : indexMemoryQuota=256 2021-11-21 22:53:42,785 - root - INFO - Setting KV memory quota as 2428 MB on 172.23.105.227 2021-11-21 22:53:42,786 - root - INFO - pools/default params : memoryQuota=2428 2021-11-21 22:53:42,794 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'n1ql', 'index']) 2021-11-21 22:53:42,794 - root - INFO - /node/controller/setupServices params on 172.23.105.227: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cn1ql%2Cindex 2021-11-21 22:53:42,830 - root - INFO - settings/indexes params : storageMode=plasma 2021-11-21 22:53:42,842 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:42,842 - root - INFO - settings/web params on 172.23.105.227:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:42,884 - root - INFO - running command.raw on 172.23.105.226: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.226 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:42,913 - root - INFO - --> status:True 2021-11-21 22:53:42,914 - root - INFO - Done with init on 172.23.105.227. 2021-11-21 22:53:42,954 - root - INFO - Done with cleanup on 172.23.105.227. 2021-11-21 22:53:43,522 - root - INFO - command executed successfully with root 2021-11-21 22:53:43,523 - root - INFO - running command.raw on 172.23.105.208: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:43,596 - root - INFO - command executed successfully with root 2021-11-21 22:53:43,596 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:43,856 - root - INFO - command executed successfully with root 2021-11-21 22:53:43,862 - root - INFO - running command.raw on 172.23.105.226: rm -rf /data/kv/* 2021-11-21 22:53:43,893 - root - INFO - command executed successfully with root 2021-11-21 22:53:43,894 - root - INFO - running command.raw on 172.23.105.226: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:43,971 - root - INFO - command executed successfully with root 2021-11-21 22:53:43,971 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:44,551 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:45,107 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:45,562 - root - INFO - Setting KV memory quota as 2684 MB on 172.23.105.223 2021-11-21 22:53:45,562 - root - INFO - pools/default params : memoryQuota=2684 2021-11-21 22:53:45,573 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2021-11-21 22:53:45,574 - root - INFO - /node/controller/setupServices params on 172.23.105.223: 8091:hostname=None&user=Administrator&password=password&services=kv 2021-11-21 22:53:45,612 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:45,613 - root - INFO - settings/web params on 172.23.105.223:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:45,699 - root - INFO - --> status:True 2021-11-21 22:53:45,700 - root - INFO - Done with init on 172.23.105.223. 2021-11-21 22:53:45,728 - root - INFO - Done with cleanup on 172.23.105.223. 2021-11-21 22:53:46,128 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.221 2021-11-21 22:53:46,128 - root - INFO - pools/default params : indexMemoryQuota=256 2021-11-21 22:53:46,138 - root - INFO - Setting KV memory quota as 2428 MB on 172.23.105.221 2021-11-21 22:53:46,139 - root - INFO - pools/default params : memoryQuota=2428 2021-11-21 22:53:46,147 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'n1ql', 'index']) 2021-11-21 22:53:46,147 - root - INFO - /node/controller/setupServices params on 172.23.105.221: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cn1ql%2Cindex 2021-11-21 22:53:46,181 - root - INFO - settings/indexes params : storageMode=plasma 2021-11-21 22:53:46,206 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:46,206 - root - INFO - settings/web params on 172.23.105.221:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:46,290 - root - INFO - --> status:True 2021-11-21 22:53:46,290 - root - INFO - Done with init on 172.23.105.221. 2021-11-21 22:53:46,319 - root - INFO - Done with cleanup on 172.23.105.221. 2021-11-21 22:53:47,122 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:47,572 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:48,136 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.208 2021-11-21 22:53:48,137 - root - INFO - pools/default params : indexMemoryQuota=256 2021-11-21 22:53:48,147 - root - INFO - Setting KV memory quota as 2428 MB on 172.23.105.208 2021-11-21 22:53:48,147 - root - INFO - pools/default params : memoryQuota=2428 2021-11-21 22:53:48,155 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'n1ql', 'index']) 2021-11-21 22:53:48,155 - root - INFO - /node/controller/setupServices params on 172.23.105.208: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cn1ql%2Cindex 2021-11-21 22:53:48,192 - root - INFO - settings/indexes params : storageMode=plasma 2021-11-21 22:53:48,230 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:48,231 - root - INFO - settings/web params on 172.23.105.208:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:48,316 - root - INFO - --> status:True 2021-11-21 22:53:48,316 - root - INFO - Done with init on 172.23.105.208. 2021-11-21 22:53:48,350 - root - INFO - Done with cleanup on 172.23.105.208. 2021-11-21 22:53:48,599 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.226 2021-11-21 22:53:48,599 - root - INFO - pools/default params : indexMemoryQuota=256 2021-11-21 22:53:48,610 - root - INFO - Setting KV memory quota as 2428 MB on 172.23.105.226 2021-11-21 22:53:48,611 - root - INFO - pools/default params : memoryQuota=2428 2021-11-21 22:53:48,619 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'n1ql', 'index']) 2021-11-21 22:53:48,620 - root - INFO - /node/controller/setupServices params on 172.23.105.226: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cn1ql%2Cindex 2021-11-21 22:53:48,654 - root - INFO - settings/indexes params : storageMode=plasma 2021-11-21 22:53:48,666 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:48,666 - root - INFO - settings/web params on 172.23.105.226:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:48,743 - root - INFO - --> status:True 2021-11-21 22:53:48,743 - root - INFO - Done with init on 172.23.105.226. 2021-11-21 22:53:48,779 - root - INFO - Done with cleanup on 172.23.105.226. 2021-11-21 22:53:51,018 - root - INFO - running command.raw on 172.23.105.220: /opt/couchbase/bin/couchbase-cli node-init -c 172.23.105.220 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2021-11-21 22:53:51,530 - root - INFO - command executed successfully with root 2021-11-21 22:53:51,537 - root - INFO - running command.raw on 172.23.105.220: rm -rf /data/kv/* 2021-11-21 22:53:51,620 - root - INFO - command executed successfully with root 2021-11-21 22:53:51,621 - root - INFO - running command.raw on 172.23.105.220: chown -R couchbase:couchbase /data/kv 2021-11-21 22:53:51,654 - root - INFO - command executed successfully with root 2021-11-21 22:53:51,655 - root - INFO - /nodes/self/controller/settings : path=%2Fdata%2Fkv 2021-11-21 22:53:54,882 - root - INFO - Setting data_path: /data/kv: status True 2021-11-21 22:53:55,934 - root - INFO - Setting INDEX memory quota as 256 MB on 172.23.105.220 2021-11-21 22:53:55,935 - root - INFO - pools/default params : indexMemoryQuota=256 2021-11-21 22:53:55,941 - root - INFO - Setting KV memory quota as 2428 MB on 172.23.105.220 2021-11-21 22:53:55,942 - root - INFO - pools/default params : memoryQuota=2428 2021-11-21 22:53:55,948 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv', 'n1ql', 'index']) 2021-11-21 22:53:55,948 - root - INFO - /node/controller/setupServices params on 172.23.105.220: 8091:hostname=None&user=Administrator&password=password&services=kv%2Cn1ql%2Cindex 2021-11-21 22:53:56,023 - root - INFO - settings/indexes params : storageMode=plasma 2021-11-21 22:53:56,036 - root - INFO - --> in init_cluster...Administrator,password,8091 2021-11-21 22:53:56,036 - root - INFO - settings/web params on 172.23.105.220:8091:port=8091&username=Administrator&password=password 2021-11-21 22:53:56,127 - root - INFO - --> status:True 2021-11-21 22:53:56,127 - root - INFO - Done with init on 172.23.105.220. 2021-11-21 22:53:56,163 - root - INFO - Done with cleanup on 172.23.105.220. 2021-11-21 22:53:58,285 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-11-21 22:53:58,353 - root - INFO - cluster:C1 node:172.23.105.223:8091 version:7.1.0-1695-enterprise aFamily:inet services:['kv'] 2021-11-21 22:53:58,353 - root - INFO - cluster:C2 node:172.23.105.221:8091 version:7.1.0-1695-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-11-21 22:53:58,353 - root - INFO - cluster:C3 node:172.23.105.220:8091 version:7.1.0-1695-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-11-21 22:53:58,354 - root - INFO - cluster:C4 node:172.23.105.208:8091 version:7.1.0-1695-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-11-21 22:53:58,354 - root - INFO - cluster:C5 node:172.23.105.226:8091 version:7.1.0-1695-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-11-21 22:53:58,354 - root - INFO - cluster:C6 node:172.23.105.227:8091 version:7.1.0-1695-enterprise aFamily:inet services:['index', 'kv', 'n1ql'] 2021-11-21 22:53:58,355 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-11-21 22:53:58,355 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-11-21 22:53:58,356 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-11-21 22:53:58,356 - root - INFO - INSTALL COMPLETED ON: 172.23.105.223 2021-11-21 22:53:58,357 - root - INFO - INSTALL COMPLETED ON: 172.23.105.221 2021-11-21 22:53:58,357 - root - INFO - INSTALL COMPLETED ON: 172.23.105.220 2021-11-21 22:53:58,357 - root - INFO - INSTALL COMPLETED ON: 172.23.105.208 2021-11-21 22:53:58,357 - root - INFO - INSTALL COMPLETED ON: 172.23.105.226 2021-11-21 22:53:58,358 - root - INFO - INSTALL COMPLETED ON: 172.23.105.227 2021-11-21 22:53:58,358 - root - INFO - ---------------------------------------------------------------------------------------------------- 2021-11-21 22:53:58,358 - root - INFO - TOTAL INSTALL TIME = 156 seconds /data/workspace/Sanjit_jython_temp/tr_for_install/testrunner/scripts/install_constants.py:50: DeprecationWarning: invalid escape sequence \ "MACOS_VERSIONS": "/Applications/Couchbase\ Server.app", /data/workspace/Sanjit_jython_temp/tr_for_install/testrunner/scripts/install_constants.py:119: DeprecationWarning: invalid escape sequence \C "rm -rf /Applications\Couchbase\ Server.app; " /data/workspace/Sanjit_jython_temp/tr_for_install/testrunner/scripts/install_constants.py:140: DeprecationWarning: invalid escape sequence \| "grep 'buildversion.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0", /data/workspace/Sanjit_jython_temp/tr_for_install/testrunner/scripts/install_constants.py:246: DeprecationWarning: invalid escape sequence \- "post_install": NON_ROOT_DOWNLOAD_DIR["LINUX_DISTROS"] + "opt/couchbase/bin/couchbase-server \-- -noinput -detached", + status=0 + cd ../.. + rm -rf tr_for_install + git clone https://github.com/gradle/guides.git Cloning into 'guides'... [Sanjit_jython_temp] $ /bin/sh -xe /tmp/jenkins4674187822639543441.sh + git fetch https://review.couchbase.org/TAF refs/changes/32/164332/111 From https://review.couchbase.org/TAF * branch refs/changes/32/164332/111 -> FETCH_HEAD + git checkout FETCH_HEAD Previous HEAD position was eed52e7... Fix tracking of available nodes. HEAD is now at 86f38b1... Adding plasma workflows tests for CRUD operations + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True' Starting a Gradle Daemon, 5 busy Daemons could not be reused, use --status for details > Configure project : Executing 'gradle clean' Using Transaction_client :: 1.2.1 Using Java_client :: 3.2.2 Running: /opt/jython/bin/jython -J-cp /data/workspace/Sanjit_jython_temp/build/classes/java/main:/data/workspace/Sanjit_jython_temp/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.2.2/f5e9f5f4f4791edbb5680d4ec7812673b0c79a2b/java-client-3.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.2.2/74e42697de31022743d5983542d2b22efe6830f0/core-io-2.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True Running: /opt/jython/bin/jython -J-cp /data/workspace/Sanjit_jython_temp/build/classes/java/main:/data/workspace/Sanjit_jython_temp/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.2.2/f5e9f5f4f4791edbb5680d4ec7812673b0c79a2b/java-client-3.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.2.2/74e42697de31022743d5983542d2b22efe6830f0/core-io-2.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True Running: /opt/jython/bin/jython -J-cp /data/workspace/Sanjit_jython_temp/build/classes/java/main:/data/workspace/Sanjit_jython_temp/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.2.2/f5e9f5f4f4791edbb5680d4ec7812673b0c79a2b/java-client-3.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.2.2/74e42697de31022743d5983542d2b22efe6830f0/core-io-2.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True Running: /opt/jython/bin/jython -J-cp /data/workspace/Sanjit_jython_temp/build/classes/java/main:/data/workspace/Sanjit_jython_temp/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.2.2/f5e9f5f4f4791edbb5680d4ec7812673b0c79a2b/java-client-3.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.2.2/74e42697de31022743d5983542d2b22efe6830f0/core-io-2.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True Running: /opt/jython/bin/jython -J-cp /data/workspace/Sanjit_jython_temp/build/classes/java/main:/data/workspace/Sanjit_jython_temp/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.2.2/f5e9f5f4f4791edbb5680d4ec7812673b0c79a2b/java-client-3.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.2.2/74e42697de31022743d5983542d2b22efe6830f0/core-io-2.2.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True > Task :compileJava warning: unknown enum constant javax.annotation.meta.When.MAYBE reason: class file for javax.annotation.meta.When not found Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 warning > Task :testrunner Global Test input params: {'cluster_name': 'sanjit', 'ini': '/tmp/sanjit.ini', 'num_nodes': 6} Logs will be stored at /data/workspace/Sanjit_jython_temp/logs/testrunner-21-Nov-21_22-54-51/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/sanjit.ini -t storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer,query_limit=50000,num_replicas=0,wait_timeout=240,moi_snapshot_interval=5000,mem_used=80,delete_perc=100,delete_by_query=False,randomize_value=True,num_items=200000,items_add=400000,key_size=240,doc_size=256,batch_size=1,doc_type=json,log_level=debug,infra_log_level=debug,sdk_timeout=60,resident_ratio=.99,active_resident_threshold=40,skip_cleanup=True,index_count=1,enable_dp=True,services_init=kv-index:n1ql-index:n1ql-kv:n1ql,dcp_services=index:n1ql-index:n1ql-kv:n1ql,num_scopes=2,num_collections=2,standard_buckets=1,time_counter=10,in_mem_comp=True,skip_cleanup=True' Test Input params: {'mem_used': '80', 'doc_size': '256', 'standard_buckets': '1', 'num_collections': '2', 'wait_timeout': '240', 'doc_type': 'json', 'num_nodes': 6, 'rerun': False, 'enable_dp': 'True', 'items_add': '400000', 'delete_by_query': 'False', 'sdk_timeout': '60', 'services_init': 'kv-index:n1ql-index:n1ql-kv:n1ql', 'delete_perc': '100', 'case_number': 1, 'dcp_services': 'index:n1ql-index:n1ql-kv:n1ql', 'query_limit': '50000', 'cluster_name': 'sanjit', 'batch_size': '1', 'ini': '/tmp/sanjit.ini', 'log_level': 'debug', 'active_resident_threshold': '40', 'logs_folder': '/data/workspace/Sanjit_jython_temp/logs/testrunner-21-Nov-21_22-54-51/test_1', 'skip_cleanup': 'True', 'num_scopes': '2', 'time_counter': '10', 'in_mem_comp': 'True', 'num_items': '200000', 'num_replicas': '0', 'resident_ratio': '.99', 'randomize_value': 'True', 'moi_snapshot_interval': '5000', 'key_size': '240', 'infra_log_level': 'debug', 'index_count': '1'} test_system_stability_with_indexer (storage.plasma.plasma_stats.PlasmaStatsTest) ... 2021-11-21 22:55:08,401 | infra | INFO | MainThread | [task_manager:__init__:13] Initiating TaskManager with 30 threads 2021-11-21 22:55:08,414 | infra | DEBUG | MainThread | [cluster:__init__:29] Initiating ServerTasks 2021-11-21 22:55:08,417 | test | INFO | MainThread | [basetestcase:log_setup_status:658] ========= PlasmaStatsTest setup started for test #1 test_system_stability_with_indexer ========= 2021-11-21 22:55:09,065 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:55:09,236 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:09,477 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:55:09,617 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:09,619 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:55:09,654 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:55:09,687 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:55:09,720 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:55:09,763 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:55:09,796 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:55:09,832 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:55:09,868 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:55:09,871 | test | INFO | MainThread | [basetestcase:log_setup_status:658] ========= BaseTestCase setup started for test #1 test_system_stability_with_indexer ========= 2021-11-21 22:55:09,877 | test | DEBUG | MainThread | [basetestcase:setUp:327] Cleaning up cluster 2021-11-21 22:55:11,556 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 120secs 2021-11-21 22:55:11,908 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:176] Waiting for ns_server @ 172.23.105.223:8091 2021-11-21 22:55:11,911 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:55:12,002 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:179] ns_server @ 172.23.105.223:8091 is running 2021-11-21 22:55:12,009 | test | WARNING | MainThread | [basetestcase:tearDownEverything:583] CLEANUP WAS SKIPPED 2021-11-21 22:55:12,013 | infra | INFO | MainThread | [basetestcase:tearDownEverything:626] ========== tasks in thread pool ========== 2021-11-21 22:55:12,015 | infra | INFO | MainThread | [basetestcase:tearDownEverything:628] ========================================== 2021-11-21 22:55:12,016 | test | INFO | MainThread | [basetestcase:initialize_cluster:414] Initializing cluster : C1 2021-11-21 22:55:12,045 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:55:12,230 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:12,483 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:55:12,638 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:12,641 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:55:12,676 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:55:12,706 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:55:12,737 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:55:12,780 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:55:12,812 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:55:12,845 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:55:13,059 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:55:13,259 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:13,503 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:55:13,641 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:13,644 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:55:13,677 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:55:13,713 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:55:13,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:55:13,782 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:55:13,812 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:55:13,839 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:55:13,877 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.223 - Checking if couchbase-server is installed 2021-11-21 22:55:13,926 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.223 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:14,023 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:14,053 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.223 - Running systemd command 2021-11-21 22:55:14,055 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: systemctl stop couchbase-server.service 2021-11-21 22:55:16,723 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.223 port:8091 ssh_username:root 2021-11-21 22:55:16,724 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:55:16,726 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -rf /data/kv/* 2021-11-21 22:55:16,756 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:16,789 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:55:16,821 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:16,875 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:55:17,049 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:17,322 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:55:17,457 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:17,461 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:55:17,493 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:55:17,522 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:55:17,552 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:55:17,591 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:55:17,621 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:55:17,651 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:55:17,684 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.223 - Checking if couchbase-server is installed 2021-11-21 22:55:17,730 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.223 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:17,815 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:17,845 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.223 - Running systemd command 2021-11-21 22:55:17,848 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: systemctl start couchbase-server.service 2021-11-21 22:55:17,901 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.223 port:8091 ssh_username:root 2021-11-21 22:55:17,904 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 Got this failure java.net.ConnectException: Connection refused: /172.23.105.223:8091 during connect (<_realsocket at 0x6 type=client open_count=1 channel=[id: 0xe686ad3f, 0.0.0.0/0.0.0.0:44168] timeout=300.0>) 2021-11-21 22:55:17,927 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:19,430 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:19,431 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.223:8091 during connect (<_realsocket at 0x7 type=client open_count=1 channel=[id: 0x42508adf, 0.0.0.0/0.0.0.0:35083] timeout=300.0>) 2021-11-21 22:55:21,444 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:21,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:21,503 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.223:8091 during connect (<_realsocket at 0x8 type=client open_count=1 channel=[id: 0xdda916e1, 0.0.0.0/0.0.0.0:40784] timeout=300.0>) 2021-11-21 22:55:23,513 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:23,559 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:23,561 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.223:8091 during connect (<_realsocket at 0x9 type=client open_count=1 channel=[id: 0xde19d41f, 0.0.0.0/0.0.0.0:42884] timeout=300.0>) 2021-11-21 22:55:25,572 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.223:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:25,617 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:25,618 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:55:27,683 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:55:27,733 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:55:27,762 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:55:27,971 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:28,236 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:55:28,378 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:28,381 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:55:28,420 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:55:28,453 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:55:28,484 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:55:28,523 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:55:28,552 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:55:28,582 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:55:28,790 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:55:28,984 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:29,227 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:55:29,374 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:29,377 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:55:29,408 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:55:29,440 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:55:29,477 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:55:29,516 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:55:29,551 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:55:29,582 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:55:29,617 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.221 - Checking if couchbase-server is installed 2021-11-21 22:55:29,664 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.221 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:29,756 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:29,786 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.221 - Running systemd command 2021-11-21 22:55:29,789 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: systemctl stop couchbase-server.service 2021-11-21 22:55:32,500 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.221 port:8091 ssh_username:root 2021-11-21 22:55:32,503 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-21 22:55:32,503 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -rf /data/kv/* 2021-11-21 22:55:32,536 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:32,569 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:55:32,601 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:32,654 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:55:32,854 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:33,128 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:55:33,266 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:33,269 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:55:33,301 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:55:33,332 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:55:33,365 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:55:33,401 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:55:33,433 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:55:33,464 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:55:33,499 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.221 - Checking if couchbase-server is installed 2021-11-21 22:55:33,565 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.221 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:33,657 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:33,687 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.221 - Running systemd command 2021-11-21 22:55:33,690 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: systemctl start couchbase-server.service 2021-11-21 22:55:33,743 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.221 port:8091 ssh_username:root 2021-11-21 22:55:33,746 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8091 during connect (<_realsocket at 0xa type=client open_count=1 channel=[id: 0xf664c692, 0.0.0.0/0.0.0.0:57162] timeout=300.0>) 2021-11-21 22:55:33,756 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:33,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:33,803 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x9aaf95c1, 0.0.0.0/0.0.0.0:54431] timeout=300.0>) 2021-11-21 22:55:35,815 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:35,859 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:35,861 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x086414ab, 0.0.0.0/0.0.0.0:54784] timeout=300.0>) 2021-11-21 22:55:37,869 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:37,914 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:37,915 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x74923de4, 0.0.0.0/0.0.0.0:45182] timeout=300.0>) 2021-11-21 22:55:39,924 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:39,967 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:39,969 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0xa6a20211, 0.0.0.0/0.0.0.0:54132] timeout=300.0>) 2021-11-21 22:55:41,977 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.221:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:42,019 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:42,020 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:55:44,075 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:55:44,121 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-21 22:55:44,144 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:55:44,367 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:44,594 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:55:44,729 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:44,730 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:55:44,762 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:55:44,792 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:55:44,822 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:55:44,865 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:55:44,897 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:55:44,927 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:55:45,112 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:55:45,309 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:45,535 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:55:45,676 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:45,678 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:55:45,710 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:55:45,740 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:55:45,780 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:55:45,821 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:55:45,851 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:55:45,882 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:55:45,917 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.220 - Checking if couchbase-server is installed 2021-11-21 22:55:45,963 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.220 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:46,051 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:46,082 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.220 - Running systemd command 2021-11-21 22:55:46,082 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: systemctl stop couchbase-server.service 2021-11-21 22:55:48,506 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.220 port:8091 ssh_username:root 2021-11-21 22:55:48,507 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-21 22:55:48,509 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -rf /data/kv/* 2021-11-21 22:55:48,542 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:48,575 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:55:48,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:55:48,660 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:55:48,867 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:55:49,107 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:55:49,249 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:55:49,252 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:55:49,286 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:55:49,316 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:55:49,348 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:55:49,382 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:55:49,411 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:55:49,443 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:55:49,477 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.220 - Checking if couchbase-server is installed 2021-11-21 22:55:49,517 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.220 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:55:49,607 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /opt/couchbase/VERSION.txt 2021-11-21 22:55:49,638 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.220 - Running systemd command 2021-11-21 22:55:49,638 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: systemctl start couchbase-server.service 2021-11-21 22:55:49,694 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.220 port:8091 ssh_username:root 2021-11-21 22:55:49,696 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x33a61469, 0.0.0.0/0.0.0.0:48734] timeout=300.0>) 2021-11-21 22:55:49,703 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:49,742 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:49,743 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x5b366da0, 0.0.0.0/0.0.0.0:42787] timeout=300.0>) 2021-11-21 22:55:51,752 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:51,792 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:51,792 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0xabe544bb, 0.0.0.0/0.0.0.0:46631] timeout=300.0>) 2021-11-21 22:55:53,826 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:53,869 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:53,871 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x9727c800, 0.0.0.0/0.0.0.0:50830] timeout=300.0>) 2021-11-21 22:55:55,881 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:55,920 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:55,921 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0xf1402a74, 0.0.0.0/0.0.0.0:50753] timeout=300.0>) 2021-11-21 22:55:57,930 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.220:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:55:57,970 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:55:57,970 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:56:00,019 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:56:00,062 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-21 22:56:00,085 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:56:00,286 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:00,565 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:56:00,697 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:00,698 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:56:00,730 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:56:00,756 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:56:00,788 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:56:00,825 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:56:00,855 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:56:00,887 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:56:01,099 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:56:01,286 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:01,543 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:56:01,686 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:01,688 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:56:01,721 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:56:01,752 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:56:01,782 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:56:01,823 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:56:01,854 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:56:01,885 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:56:01,924 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.208 - Checking if couchbase-server is installed 2021-11-21 22:56:01,969 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.208 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:02,065 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:02,095 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.208 - Running systemd command 2021-11-21 22:56:02,096 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: systemctl stop couchbase-server.service 2021-11-21 22:56:04,157 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.208 port:8091 ssh_username:root 2021-11-21 22:56:04,160 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:56:04,161 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -rf /data/kv/* 2021-11-21 22:56:04,191 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:04,226 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:56:04,256 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:04,305 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:56:04,490 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:04,743 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:56:04,878 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:04,881 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:56:04,911 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:56:04,940 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:56:04,970 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:56:05,007 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:56:05,038 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:56:05,068 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:56:05,099 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.208 - Checking if couchbase-server is installed 2021-11-21 22:56:05,144 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.208 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:05,227 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:05,257 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.208 - Running systemd command 2021-11-21 22:56:05,259 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: systemctl start couchbase-server.service 2021-11-21 22:56:05,312 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.208 port:8091 ssh_username:root 2021-11-21 22:56:05,315 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x6b4e4b50, 0.0.0.0/0.0.0.0:37265] timeout=300.0>) 2021-11-21 22:56:05,323 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:05,364 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:05,365 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xdc981688, 0.0.0.0/0.0.0.0:40484] timeout=300.0>) 2021-11-21 22:56:07,391 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:07,430 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:07,431 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x7718e750, 0.0.0.0/0.0.0.0:43633] timeout=300.0>) 2021-11-21 22:56:09,443 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:09,487 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:09,489 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x0903a0b5, 0.0.0.0/0.0.0.0:44717] timeout=300.0>) 2021-11-21 22:56:11,499 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:11,538 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:11,539 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0x95bc61ae, 0.0.0.0/0.0.0.0:45938] timeout=300.0>) 2021-11-21 22:56:13,546 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.208:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:13,584 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:13,585 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:56:15,631 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:56:15,677 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:56:15,697 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:56:15,849 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:16,134 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:56:16,276 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:16,278 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:56:16,311 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:56:16,346 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:56:16,378 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:56:16,417 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:56:16,450 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:56:16,482 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:56:16,667 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:56:16,842 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:17,101 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:56:17,246 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:17,247 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:56:17,282 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:56:17,312 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:56:17,344 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:56:17,384 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:56:17,414 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:56:17,450 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:56:17,484 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.226 - Checking if couchbase-server is installed 2021-11-21 22:56:17,532 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.226 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:17,621 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:17,651 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.226 - Running systemd command 2021-11-21 22:56:17,653 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: systemctl stop couchbase-server.service 2021-11-21 22:56:19,558 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.226 port:8091 ssh_username:root 2021-11-21 22:56:19,559 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-21 22:56:19,562 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -rf /data/kv/* 2021-11-21 22:56:19,601 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:19,635 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:56:19,665 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:19,711 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:56:19,885 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:20,164 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:56:20,312 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:20,315 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:56:20,349 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:56:20,381 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:56:20,413 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:56:20,454 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:56:20,487 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:56:20,519 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:56:20,552 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.226 - Checking if couchbase-server is installed 2021-11-21 22:56:20,595 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.226 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:20,684 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:20,713 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.226 - Running systemd command 2021-11-21 22:56:20,716 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: systemctl start couchbase-server.service 2021-11-21 22:56:20,765 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.226 port:8091 ssh_username:root 2021-11-21 22:56:20,766 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 Got this failure java.net.ConnectException: Connection refused: /172.23.105.226:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x108cdf98, 0.0.0.0/0.0.0.0:38028] timeout=300.0>) 2021-11-21 22:56:20,776 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:20,812 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:20,813 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.226:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0xfe1deb4f, 0.0.0.0/0.0.0.0:55154] timeout=300.0>) 2021-11-21 22:56:22,822 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:22,858 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:22,859 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.226:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0xfaf50cb1, 0.0.0.0/0.0.0.0:60467] timeout=300.0>) 2021-11-21 22:56:24,868 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:24,908 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:24,911 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.226:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x8ef4aef0, 0.0.0.0/0.0.0.0:47091] timeout=300.0>) 2021-11-21 22:56:26,920 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:26,963 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:26,963 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.226:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x62041610, 0.0.0.0/0.0.0.0:42465] timeout=300.0>) 2021-11-21 22:56:28,973 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.226:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:29,016 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:29,017 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:56:31,065 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:56:31,117 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-21 22:56:31,138 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:56:31,315 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:31,565 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:56:31,726 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:31,727 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:56:31,759 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:56:31,789 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:56:31,822 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:56:31,859 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:56:31,890 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:56:31,921 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:56:32,112 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:56:32,276 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:32,530 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:56:32,674 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:32,676 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:56:32,709 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:56:32,740 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:56:32,773 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:56:32,809 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:56:32,842 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:56:32,875 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:56:32,911 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.227 - Checking if couchbase-server is installed 2021-11-21 22:56:32,960 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.227 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:33,053 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:33,086 | infra | DEBUG | MainThread | [remote_util:stop_couchbase:3806] 172.23.105.227 - Running systemd command 2021-11-21 22:56:33,091 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: systemctl stop couchbase-server.service 2021-11-21 22:56:35,881 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:474] Couchbase stopped on ip:172.23.105.227 port:8091 ssh_username:root 2021-11-21 22:56:35,882 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-21 22:56:35,884 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -rf /data/kv/* 2021-11-21 22:56:35,915 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:35,950 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -rf /opt/couchbase/var/lib/couchbase/crash//* 2021-11-21 22:56:35,983 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -rf /opt/couchbase/var/lib/couchbase/config//* 2021-11-21 22:56:36,035 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:56:36,278 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:36,515 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:56:36,648 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:36,650 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:56:36,676 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:56:36,711 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:56:36,743 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:56:36,782 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:56:36,809 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:56:36,839 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:56:36,875 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:716] 172.23.105.227 - Checking if couchbase-server is installed 2021-11-21 22:56:36,923 | infra | DEBUG | MainThread | [remote_util:is_couchbase_installed:749] 172.23.105.227 - The version file /opt/couchbase/ VERSION.txt exists 2021-11-21 22:56:37,012 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /opt/couchbase/VERSION.txt 2021-11-21 22:56:37,042 | infra | DEBUG | MainThread | [remote_util:start_couchbase:3906] 172.23.105.227 - Running systemd command 2021-11-21 22:56:37,042 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: systemctl start couchbase-server.service 2021-11-21 22:56:37,096 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:488] Couchbase started on ip:172.23.105.227 port:8091 ssh_username:root 2021-11-21 22:56:37,098 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 Got this failure java.net.ConnectException: Connection refused: /172.23.105.227:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x15208ea3, 0.0.0.0/0.0.0.0:51215] timeout=300.0>) 2021-11-21 22:56:37,108 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:37,147 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:37,148 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.227:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x5c88f5c4, 0.0.0.0/0.0.0.0:41128] timeout=300.0>) 2021-11-21 22:56:39,157 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:39,194 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:39,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.227:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x26f4651b, 0.0.0.0/0.0.0.0:52091] timeout=300.0>) 2021-11-21 22:56:41,203 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:41,236 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:41,236 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.227:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0x01c7141b, 0.0.0.0/0.0.0.0:36023] timeout=300.0>) 2021-11-21 22:56:43,244 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:43,279 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:43,280 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.227:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x5842b703, 0.0.0.0/0.0.0.0:58476] timeout=300.0>) 2021-11-21 22:56:45,289 | test | ERROR | MainThread | [rest_client:_http_request:828] Socket error while connecting to http://172.23.105.227:8091/nodes/self error [Errno 111] Connection refused 2021-11-21 22:56:45,323 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _http_request():L838 2021-11-21 22:56:45,325 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:56:47,378 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:57] Checking if ns_server is running with timeout 360secs 2021-11-21 22:56:47,421 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-21 22:56:47,453 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> reset_cluster():L562 2021-11-21 22:56:47,453 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-21 22:56:57,473 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:56:57,634 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:57,855 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:56:57,986 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:57,986 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:56:58,019 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:56:58,049 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:56:58,081 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:56:58,121 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:56:58,154 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:56:58,186 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:56:58,236 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:56:58,401 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:58,680 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:56:58,839 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:58,841 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:56:58,874 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:56:58,904 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:56:58,936 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:56:58,976 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:56:59,006 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:56:59,039 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:56:59,092 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:56:59,315 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:56:59,573 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:56:59,717 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:56:59,719 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:56:59,752 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:56:59,782 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:56:59,813 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:56:59,855 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:56:59,884 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:56:59,917 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:56:59,967 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:57:00,174 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:00,447 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:57:00,588 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:00,589 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:57:00,627 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:57:00,661 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:57:00,697 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:57:00,740 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:57:00,772 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:57:00,802 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:57:00,855 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:57:01,095 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:01,371 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:57:01,502 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:01,503 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:57:01,539 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:57:01,572 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:57:01,607 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:57:01,650 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:57:01,683 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:57:01,714 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:57:01,769 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:57:01,970 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:02,224 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:57:02,362 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:02,365 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:57:02,397 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:57:02,430 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:57:02,456 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:57:02,496 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:57:02,529 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:57:02,559 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:57:02,594 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -rf /data/kv/* 2021-11-21 22:57:02,627 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:02,700 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:05,724 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:05,730 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.223_8091 2021-11-21 22:57:05,730 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'node_init_task_172.23.105.223_8091' started 2021-11-21 22:57:05,733 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -rf /data/kv/* 2021-11-21 22:57:05,769 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:05,855 | infra | DEBUG | pool-3-thread-1 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:05,865 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:05,880 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:05,884 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:05,960 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:05,960 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:06,040 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:06,042 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:06,164 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:06,164 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:06,315 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:06,315 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:06,548 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:06,549 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:06,946 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:06,947 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:07,658 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:07,660 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:08,815 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:08,816 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.221_8091 2021-11-21 22:57:08,819 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'node_init_task_172.23.105.221_8091' started 2021-11-21 22:57:08,819 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -rf /data/kv/* 2021-11-21 22:57:08,852 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:09,055 | infra | DEBUG | pool-3-thread-2 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:09,063 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:09,068 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,069 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:09,085 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,085 | test | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:09,151 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,153 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:09,239 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,240 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:09,328 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,329 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:09,457 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,457 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:09,665 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:09,667 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:10,033 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:10,035 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:10,723 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:10,724 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:11,687 | test | DEBUG | pool-3-thread-1 | [task:call:5874] server: ip:172.23.105.223 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3614851072L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.223:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.223', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'110', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201844736L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:11,691 | test | DEBUG | pool-3-thread-1 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:11,733 | test | DEBUG | pool-3-thread-1 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:11,779 | test | DEBUG | pool-3-thread-1 | [rest_client:init_node_services:913] /node/controller/setupServices params on 172.23.105.223: 8091:services=kv&hostname=172.23.105.223&password=password&user=Administrator 2021-11-21 22:57:11,848 | test | DEBUG | pool-3-thread-1 | [rest_client:init_cluster:846] settings/web params on 172.23.105.223:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:12,055 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,056 | test | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:12,082 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:12,085 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.220_8091 2021-11-21 22:57:12,085 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'node_init_task_172.23.105.220_8091' started 2021-11-21 22:57:12,086 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -rf /data/kv/* 2021-11-21 22:57:12,118 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:12,161 | infra | DEBUG | pool-3-thread-3 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:12,170 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,171 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:12,191 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:12,230 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,232 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:12,302 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,302 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:12,388 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,388 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:12,519 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,520 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:12,732 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:12,733 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:13,107 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:13,108 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:13,802 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:13,802 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:14,657 | test | DEBUG | pool-3-thread-2 | [task:call:5874] server: ip:172.23.105.221 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3644452864L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.221:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.221', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'97', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201840640L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:14,661 | test | DEBUG | pool-3-thread-2 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:14,694 | test | DEBUG | pool-3-thread-2 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:14,733 | test | DEBUG | pool-3-thread-2 | [rest_client:init_cluster:846] settings/web params on 172.23.105.221:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:15,131 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,132 | test | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:15,232 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:15,233 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.208_8091 2021-11-21 22:57:15,236 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'node_init_task_172.23.105.208_8091' started 2021-11-21 22:57:15,236 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -rf /data/kv/* 2021-11-21 22:57:15,272 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:15,319 | infra | DEBUG | pool-3-thread-4 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:15,328 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,329 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:15,345 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:15,384 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,384 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:15,450 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,451 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:15,539 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,540 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:15,671 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,671 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:15,875 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:15,877 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:16,263 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:16,265 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:16,951 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:16,953 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:17,730 | test | DEBUG | pool-3-thread-3 | [task:call:5874] server: ip:172.23.105.220 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3681710080L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.220:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.220', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'85', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201840640L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:17,733 | test | DEBUG | pool-3-thread-3 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:17,769 | test | DEBUG | pool-3-thread-3 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:17,815 | test | DEBUG | pool-3-thread-3 | [rest_client:init_cluster:846] settings/web params on 172.23.105.220:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:18,286 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,286 | test | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:18,365 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:18,368 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.226_8091 2021-11-21 22:57:18,369 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -rf /data/kv/* 2021-11-21 22:57:18,369 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'node_init_task_172.23.105.226_8091' started 2021-11-21 22:57:18,401 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: chown -R couchbase:couchbase /data/kv 2021-11-21 22:57:18,454 | infra | DEBUG | pool-3-thread-5 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:18,464 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,466 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:18,471 | test | DEBUG | MainThread | [rest_client:set_data_path:2232] /nodes/self/controller/settings: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv 2021-11-21 22:57:18,530 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,532 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:18,624 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,625 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:18,717 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,717 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:18,846 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:18,848 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:19,053 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:19,055 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:19,417 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:19,420 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:20,111 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:20,112 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:20,891 | test | DEBUG | pool-3-thread-4 | [task:call:5874] server: ip:172.23.105.208 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3610849280L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.208:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.208', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'72', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201840640L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:20,894 | test | DEBUG | pool-3-thread-4 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:20,941 | test | DEBUG | pool-3-thread-4 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:20,994 | test | DEBUG | pool-3-thread-4 | [rest_client:init_cluster:846] settings/web params on 172.23.105.208:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:21,441 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:21,443 | test | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:21,582 | test | DEBUG | MainThread | [rest_client:set_data_path:2235] Setting paths: path=%2Fdata%2Fkv&index_path=%2Fdata%2Fkv: status 1 2021-11-21 22:57:21,582 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: node_init_task_172.23.105.227_8091 2021-11-21 22:57:21,585 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.223_8091 2021-11-21 22:57:21,585 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'node_init_task_172.23.105.227_8091' started 2021-11-21 22:57:21,585 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.221_8091 2021-11-21 22:57:21,588 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.220_8091 2021-11-21 22:57:21,588 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.208_8091 2021-11-21 22:57:21,589 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.226_8091 2021-11-21 22:57:21,667 | infra | DEBUG | pool-3-thread-6 | [task:wait_until:133] Wait for expected condition to get satisfied 2021-11-21 22:57:21,676 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:21,677 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-11-21 22:57:21,733 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:21,733 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-11-21 22:57:21,799 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:21,801 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-11-21 22:57:21,885 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:21,887 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-11-21 22:57:22,007 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:22,009 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-11-21 22:57:22,211 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:22,213 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-11-21 22:57:22,578 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:22,579 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-11-21 22:57:23,269 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:23,272 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-11-21 22:57:24,042 | test | DEBUG | pool-3-thread-5 | [task:call:5874] server: ip:172.23.105.226 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3623022592L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.226:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.226', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'60', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201840640L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:24,045 | test | DEBUG | pool-3-thread-5 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:24,078 | test | DEBUG | pool-3-thread-5 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:24,117 | test | DEBUG | pool-3-thread-5 | [rest_client:init_cluster:846] settings/web params on 172.23.105.226:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:24,335 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for node_init_task_172.23.105.227_8091 2021-11-21 22:57:24,594 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L138 2021-11-21 22:57:24,595 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-11-21 22:57:27,188 | test | DEBUG | pool-3-thread-6 | [task:call:5874] server: ip:172.23.105.227 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 3642933248L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 1211, 'hostname': u'172.23.105.227:8091', 'ftsMemoryQuota': 256, 'clusterCompatibility': 458753, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 3205, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-pc-linux-gnu', 'ip': u'172.23.105.227', 'curr_items': 0, 'mcdMemoryAllocated': 3205, 'services': [u'kv'], 'version': u'7.1.0-1695-enterprise', 'indexMemoryQuota': 512, 'uptime': u'47', 'clusterMembership': u'active', 'storageTotalRam': 4007L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 4201840640L, 'memoryQuota': 1738, 'status': u'healthy'} 2021-11-21 22:57:27,191 | test | DEBUG | pool-3-thread-6 | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'memoryQuota': 2794} 2021-11-21 22:57:27,227 | test | DEBUG | pool-3-thread-6 | [rest_client:set_indexer_storage_mode:959] settings/indexes params: storageMode=plasma 2021-11-21 22:57:27,269 | test | DEBUG | pool-3-thread-6 | [rest_client:init_cluster:846] settings/web params on 172.23.105.227:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:27,500 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:710] RAM quota was defined less than 100 MB: 2021-11-21 22:57:27,502 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.223: RAM: ['MemTotal: 4103364 kB\n', 'MemFree: 1488968 kB\n', 'MemAvailable: 3354568 kB\n', 'Buffers: 0 kB\n', 'Cached: 2038264 kB\n', 'SwapCached: 4340 kB\n', 'Active: 962720 kB\n', 'Inactive: 1315652 kB\n', 'Active(anon): 242472 kB\n', 'Inactive(anon): 38664 kB\n', 'Active(file): 720248 kB\n', 'Inactive(file): 1276988 kB\n', 'Unevictable: 12232 kB\n', 'Mlocked: 12232 kB\n', 'SwapTotal: 3670012 kB\n', 'SwapFree: 3526396 kB\n', 'Dirty: 104 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 249588 kB\n', 'Mapped: 102800 kB\n', 'Shmem: 37392 kB\n', 'Slab: 220724 kB\n', 'SReclaimable: 142552 kB\n', 'SUnreclaim: 78172 kB\n', 'KernelStack: 7728 kB\n', 'PageTables: 7700 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 5721692 kB\n', 'Committed_AS: 1478408 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 63944 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 0 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 88064 kB\n', 'DirectMap2M: 4352000 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,503 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.221: RAM: ['MemTotal: 4103360 kB\n', 'MemFree: 1365968 kB\n', 'MemAvailable: 3176924 kB\n', 'Buffers: 0 kB\n', 'Cached: 2192404 kB\n', 'SwapCached: 0 kB\n', 'Active: 1108892 kB\n', 'Inactive: 1365168 kB\n', 'Active(anon): 357480 kB\n', 'Inactive(anon): 151580 kB\n', 'Active(file): 751412 kB\n', 'Inactive(file): 1213588 kB\n', 'Unevictable: 11256 kB\n', 'Mlocked: 11256 kB\n', 'SwapTotal: 0 kB\n', 'SwapFree: 0 kB\n', 'Dirty: 140 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 293064 kB\n', 'Mapped: 103648 kB\n', 'Shmem: 223768 kB\n', 'Slab: 155832 kB\n', 'SReclaimable: 97884 kB\n', 'SUnreclaim: 57948 kB\n', 'KernelStack: 7728 kB\n', 'PageTables: 7580 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 2051680 kB\n', 'Committed_AS: 1580804 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 63036 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 8192 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 108544 kB\n', 'DirectMap2M: 4331520 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,503 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.220: RAM: ['MemTotal: 4103360 kB\n', 'MemFree: 1576172 kB\n', 'MemAvailable: 3390500 kB\n', 'Buffers: 0 kB\n', 'Cached: 2018932 kB\n', 'SwapCached: 2676 kB\n', 'Active: 998688 kB\n', 'Inactive: 1263492 kB\n', 'Active(anon): 238612 kB\n', 'Inactive(anon): 55652 kB\n', 'Active(file): 760076 kB\n', 'Inactive(file): 1207840 kB\n', 'Unevictable: 9504 kB\n', 'Mlocked: 9504 kB\n', 'SwapTotal: 3670012 kB\n', 'SwapFree: 3578644 kB\n', 'Dirty: 72 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 250624 kB\n', 'Mapped: 109240 kB\n', 'Shmem: 47376 kB\n', 'Slab: 156572 kB\n', 'SReclaimable: 98800 kB\n', 'SUnreclaim: 57772 kB\n', 'KernelStack: 7712 kB\n', 'PageTables: 7564 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 5721692 kB\n', 'Committed_AS: 1445460 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 63944 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 0 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 98304 kB\n', 'DirectMap2M: 4341760 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,505 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.208: RAM: ['MemTotal: 4103360 kB\n', 'MemFree: 1514464 kB\n', 'MemAvailable: 3349920 kB\n', 'Buffers: 0 kB\n', 'Cached: 2011120 kB\n', 'SwapCached: 4584 kB\n', 'Active: 995700 kB\n', 'Inactive: 1257096 kB\n', 'Active(anon): 244304 kB\n', 'Inactive(anon): 39364 kB\n', 'Active(file): 751396 kB\n', 'Inactive(file): 1217732 kB\n', 'Unevictable: 12216 kB\n', 'Mlocked: 12216 kB\n', 'SwapTotal: 3670012 kB\n', 'SwapFree: 3415932 kB\n', 'Dirty: 20 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 250988 kB\n', 'Mapped: 104188 kB\n', 'Shmem: 38372 kB\n', 'Slab: 218192 kB\n', 'SReclaimable: 138628 kB\n', 'SUnreclaim: 79564 kB\n', 'KernelStack: 8064 kB\n', 'PageTables: 7624 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 5721692 kB\n', 'Committed_AS: 1608152 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 62920 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 0 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 98304 kB\n', 'DirectMap2M: 4341760 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,506 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.226: RAM: ['MemTotal: 4103360 kB\n', 'MemFree: 465668 kB\n', 'MemAvailable: 3362328 kB\n', 'Buffers: 147648 kB\n', 'Cached: 2925888 kB\n', 'SwapCached: 3868 kB\n', 'Active: 1448712 kB\n', 'Inactive: 1867336 kB\n', 'Active(anon): 248228 kB\n', 'Inactive(anon): 42312 kB\n', 'Active(file): 1200484 kB\n', 'Inactive(file): 1825024 kB\n', 'Unevictable: 10732 kB\n', 'Mlocked: 10732 kB\n', 'SwapTotal: 3670012 kB\n', 'SwapFree: 3495588 kB\n', 'Dirty: 108 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 251016 kB\n', 'Mapped: 111012 kB\n', 'Shmem: 44380 kB\n', 'Slab: 211556 kB\n', 'SReclaimable: 148276 kB\n', 'SUnreclaim: 63280 kB\n', 'KernelStack: 7744 kB\n', 'PageTables: 7620 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 5721692 kB\n', 'Committed_AS: 1526804 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 63944 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 0 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 151552 kB\n', 'DirectMap2M: 4288512 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,506 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:713] Node: 172.23.105.227: RAM: ['MemTotal: 4103360 kB\n', 'MemFree: 1277800 kB\n', 'MemAvailable: 3148580 kB\n', 'Buffers: 0 kB\n', 'Cached: 2274228 kB\n', 'SwapCached: 0 kB\n', 'Active: 1101272 kB\n', 'Inactive: 1457240 kB\n', 'Active(anon): 338824 kB\n', 'Inactive(anon): 197072 kB\n', 'Active(file): 762448 kB\n', 'Inactive(file): 1260168 kB\n', 'Unevictable: 8724 kB\n', 'Mlocked: 8724 kB\n', 'SwapTotal: 0 kB\n', 'SwapFree: 0 kB\n', 'Dirty: 412 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 292988 kB\n', 'Mapped: 103204 kB\n', 'Shmem: 247976 kB\n', 'Slab: 162176 kB\n', 'SReclaimable: 102300 kB\n', 'SUnreclaim: 59876 kB\n', 'KernelStack: 7600 kB\n', 'PageTables: 7424 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 2051680 kB\n', 'Committed_AS: 1598032 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 63036 kB\n', 'VmallocChunk: 34359662588 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 0 kB\n', 'CmaTotal: 0 kB\n', 'CmaFree: 0 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 110592 kB\n', 'DirectMap2M: 4329472 kB\n', 'DirectMap1G: 0 kB\n'] 2021-11-21 22:57:27,507 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:57:27,509 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-21 22:57:27,510 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-21 22:57:27,512 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:57:27,513 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-21 22:57:27,513 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-21 22:57:27,532 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:57:27,697 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:27,934 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:57:28,088 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:28,089 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:57:28,118 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:57:28,150 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:57:28,180 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:57:28,220 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:57:28,253 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:57:28,280 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:57:28,311 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:28,341 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.223 port:8091 ssh_username:root: [] 2021-11-21 22:57:28,342 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:57:28,342 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:28,361 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:57:28,596 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:28,865 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:57:29,002 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:29,003 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:57:29,036 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:57:29,065 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:57:29,101 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:57:29,141 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:57:29,173 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:57:29,203 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:57:29,236 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:29,270 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.221 port:8091 ssh_username:root: [] 2021-11-21 22:57:29,272 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-21 22:57:29,273 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:29,289 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:57:29,448 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:29,711 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:57:29,848 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:29,849 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:57:29,882 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:57:29,914 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:57:29,944 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:57:29,984 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:57:30,017 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:57:30,052 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:57:30,085 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:30,121 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.220 port:8091 ssh_username:root: [] 2021-11-21 22:57:30,121 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-21 22:57:30,122 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:30,141 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:57:30,329 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:30,598 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:57:30,737 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:30,740 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:57:30,770 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:57:30,801 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:57:30,831 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:57:30,869 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:57:30,903 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:57:30,934 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:57:30,969 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:31,002 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.208 port:8091 ssh_username:root: [] 2021-11-21 22:57:31,003 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:57:31,003 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:31,022 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:57:31,187 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:31,453 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:57:31,601 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:31,602 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:57:31,635 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:57:31,667 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:57:31,703 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:57:31,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:57:31,783 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:57:31,821 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:57:31,854 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:31,888 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.226 port:8091 ssh_username:root: [] 2021-11-21 22:57:31,890 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-21 22:57:31,891 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:31,910 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:57:32,095 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:32,354 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:57:32,493 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:32,494 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:57:32,529 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:57:32,562 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:57:32,595 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:57:32,634 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:57:32,667 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:57:32,700 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:57:32,733 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep ^COUCHBASE_NUM_VBUCKETS /opt/couchbase/bin/couchbase-server | cut -d "=" -f 2 2021-11-21 22:57:32,766 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:340] Current vBuckets on node ip:172.23.105.227 port:8091 ssh_username:root: [] 2021-11-21 22:57:32,767 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-21 22:57:32,769 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:359] ========= CHANGED ENVIRONMENT SETTING =========== 2021-11-21 22:57:32,770 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:361] Wait for all the services to come up after change_env_vars update 2021-11-21 22:57:32,799 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> change_env_variables():L363 2021-11-21 22:57:32,801 | infra | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-21 22:57:42,802 | test | INFO | MainThread | [basetestcase:initialize_cluster:439] Cluster C1 initialized 2021-11-21 22:57:42,890 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:57:43,085 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:43,315 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:57:43,448 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:43,450 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:57:43,483 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:57:43,513 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:57:43,543 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:57:43,579 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:57:43,609 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:57:43,638 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:57:43,671 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:44,095 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:57:44,114 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-21 22:57:44,278 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:44,555 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-21 22:57:44,697 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:44,698 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-21 22:57:44,733 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-21 22:57:44,766 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-21 22:57:44,798 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-21 22:57:44,838 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-21 22:57:44,871 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-21 22:57:44,901 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-21 22:57:44,936 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:45,352 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-21 22:57:45,371 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-21 22:57:45,569 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:45,825 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-21 22:57:45,964 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:45,966 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-21 22:57:45,997 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-21 22:57:46,028 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-21 22:57:46,059 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-21 22:57:46,095 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-21 22:57:46,127 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-21 22:57:46,157 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-21 22:57:46,191 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:46,650 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-21 22:57:46,667 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:57:46,858 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:47,119 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:57:47,323 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:47,325 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:57:47,362 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:57:47,398 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:57:47,437 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:57:47,482 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:57:47,516 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:57:47,546 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:57:47,579 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:47,992 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:57:48,010 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-21 22:57:48,200 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:48,512 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-21 22:57:48,650 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:48,651 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-21 22:57:48,686 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-21 22:57:48,713 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-21 22:57:48,743 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-21 22:57:48,786 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-21 22:57:48,816 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-21 22:57:48,848 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-21 22:57:48,881 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:49,316 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-21 22:57:49,335 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-21 22:57:49,510 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:57:49,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-21 22:57:49,885 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:57:49,887 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-21 22:57:49,921 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-21 22:57:49,953 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-21 22:57:49,984 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-21 22:57:50,023 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-21 22:57:50,055 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-21 22:57:50,088 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-21 22:57:50,124 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: echo 'y' | /opt/couchbase/bin/couchbase-cli enable-developer-preview --enable -c localhost:8091 -u Administrator -p password 2021-11-21 22:57:50,582 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-21 22:57:50,582 | test | INFO | MainThread | [basetestcase:log_setup_status:658] ========= BaseTestCase setup finished for test #1 test_system_stability_with_indexer ========= 2021-11-21 22:57:50,747 | test | DEBUG | MainThread | [bucket_ready_functions:add_rbac_user:4128] **** Add built-in 'cbadminbucket' user to node 172.23.105.223 **** 2021-11-21 22:57:50,961 | test | DEBUG | MainThread | [bucket_ready_functions:add_rbac_user:4132] **** Add 'admin' role to 'cbadminbucket' user **** 2021-11-21 22:57:51,032 | test | DEBUG | MainThread | [rest_client:init_cluster:846] settings/web params on 172.23.105.223:8091:password=password&port=8091&username=Administrator 2021-11-21 22:57:51,173 | test | DEBUG | MainThread | [rest_client:set_service_mem_quota:935] Setting RAM quotas: {'indexMemoryQuota': 3105} 2021-11-21 22:57:51,296 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: Rebalance_task_IN=[172.23.105.221,172.23.105.220,172.23.105.208]_OUT=[]_1637564271.21 2021-11-21 22:57:51,296 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'Rebalance_task_IN=[172.23.105.221,172.23.105.220,172.23.105.208]_OUT=[]_1637564271.21' started 2021-11-21 22:57:51,299 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for Rebalance_task_IN=[172.23.105.221,172.23.105.220,172.23.105.208]_OUT=[]_1637564271.21 2021-11-21 22:57:51,302 | test | DEBUG | pool-3-thread-7 | [rest_client:add_node:1177] Adding remote node 172.23.105.221:8091 to cluster 172.23.105.223:8091 2021-11-21 22:57:56,049 | test | DEBUG | pool-3-thread-7 | [rest_client:add_node:1177] Adding remote node 172.23.105.220:8091 to cluster 172.23.105.223:8091 2021-11-21 22:58:00,443 | test | DEBUG | pool-3-thread-7 | [rest_client:add_node:1177] Adding remote node 172.23.105.208:8091 to cluster 172.23.105.223:8091 2021-11-21 22:58:04,950 | test | DEBUG | pool-3-thread-7 | [rest_client:rebalance:1430] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.105.220,ns_1@172.23.105.223,ns_1@172.23.105.221,ns_1@172.23.105.208', 'ejectedNodes': '', 'user': 'Administrator'} 2021-11-21 22:58:05,039 | test | DEBUG | pool-3-thread-7 | [rest_client:rebalance:1435] Rebalance operation started 2021-11-21 22:58:05,042 | test | INFO | pool-3-thread-7 | [table_view:display:72] Rebalance Overview +----------------+----------------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------------+-----------------------+---------------+--------------+ | 172.23.105.223 | kv | 7.1.0-1695-enterprise | 2.51004016064 | Cluster node | | 172.23.105.221 | ['index,n1ql'] | | | <--- IN --- | | 172.23.105.220 | ['index,n1ql'] | | | <--- IN --- | | 172.23.105.208 | ['kv,n1ql'] | | | <--- IN --- | +----------------+----------------+-----------------------+---------------+--------------+ 2021-11-21 22:58:05,084 | test | DEBUG | pool-3-thread-7 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 0.00 % 2021-11-21 22:58:05,085 | test | INFO | pool-3-thread-7 | [task:check:384] Rebalance - status: running, progress: 0.0 2021-11-21 22:58:05,135 | infra | DEBUG | pool-3-thread-7 | [task:check:411] Wait before next rebalance progress check 2021-11-21 22:58:05,145 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-21 22:58:05,147 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-21 22:58:15,197 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> _rebalance_status_and_progress():L1648 2021-11-21 22:58:15,198 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 5 seconds. Reason: None 2021-11-21 22:58:20,240 | test | INFO | pool-3-thread-7 | [task:check:384] Rebalance - status: none, progress: 100 2021-11-21 22:58:20,289 | test | INFO | pool-3-thread-7 | [task:check:443] Rebalance completed with progress: 100% in 15.2470002174 sec 2021-11-21 22:58:20,289 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'Rebalance_task_IN=[172.23.105.221,172.23.105.220,172.23.105.208]_OUT=[]_1637564271.21' completed 2021-11-21 22:58:20,371 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1569] Creating bucket: default 2021-11-21 22:58:20,372 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: bucket_default_create_task 2021-11-21 22:58:20,374 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for bucket_default_create_task 2021-11-21 22:58:20,592 | infra | INFO | pool-3-thread-8 | [BucketOperations_Rest:create_bucket:344] Creating 'couchbase' bucket default 2021-11-21 22:58:20,592 | infra | DEBUG | pool-3-thread-8 | [BucketOperations_Rest:create_bucket:346] http://172.23.105.223:8091/pools/default/buckets with param: storageBackend=magma&viewFragmentationThreshold%255Bpercentage%255D=50&fragmentationPercentage=50&replicaIndex=1&maxTTL=0&indexCompactionMode=circular&databaseFragmentationThreshold%255Bpercentage%255D=50&flushEnabled=0¶llelDBAndViewCompaction=false&durabilityMinLevel=none&compressionMode=off&purgeInterval=3&bucketType=couchbase&autoCompactionDefined=false&conflictResolutionType=seqno&name=default&replicaNumber=1&ramQuotaMB=2793&evictionPolicy=fullEviction 2021-11-21 22:58:20,664 | infra | DEBUG | pool-3-thread-8 | [BucketOperations_Rest:create_bucket:354] 0.07 seconds to create bucket default 2021-11-21 22:58:20,667 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'bucket_default_create_task' completed 2021-11-21 22:58:20,667 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1581] Wait for memcached to accept cbstats or any other bucket request connections 2021-11-21 22:58:20,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1583 2021-11-21 22:58:20,716 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:58:22,881 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 22:58:22,884 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:4080] Waiting for bucket default to complete warm-up 2021-11-21 22:58:22,903 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 22:58:23,019 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:58:23,296 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 22:58:23,400 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:58:23,401 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 22:58:23,428 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 22:58:23,451 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 22:58:23,480 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 22:58:23,506 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 22:58:23,529 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 22:58:23,549 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 22:58:23,576 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default all 2021-11-21 22:58:23,917 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 22:58:23,937 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 22:58:24,102 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 22:58:24,398 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 22:58:24,520 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 22:58:24,523 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 22:58:24,552 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 22:58:24,579 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 22:58:24,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 22:58:24,638 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 22:58:24,674 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 22:58:24,698 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 22:58:24,730 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default all 2021-11-21 22:58:24,969 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 22:58:25,015 | infra | INFO | MainThread | [BucketOperations_Rest:update_memcached_settings:373] Updating memcached properties 2021-11-21 22:58:25,016 | infra | DEBUG | MainThread | [BucketOperations_Rest:update_memcached_settings:374] http://172.23.105.223:8091/pools/default/settings/memcached/global with param: num_reader_threads=disk_io_optimized&num_writer_threads=disk_io_optimized&num_storage_threads=default 2021-11-21 22:58:25,078 | infra | DEBUG | MainThread | [BucketOperations_Rest:update_memcached_settings:380] Memcached settings updated 2021-11-21 22:58:25,079 | test | INFO | MainThread | [storage_base:setUp:140] Creating bucket::scope default Scope1 2021-11-21 22:58:25,081 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1191] Creating Scope default:Scope1 2021-11-21 22:58:25,209 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/storage_base.py -> setUp():L145 2021-11-21 22:58:25,210 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:58:27,213 | test | INFO | MainThread | [storage_base:setUp:147] Scopes list is ['_default', 'Scope1'] 2021-11-21 22:58:27,214 | test | INFO | MainThread | [storage_base:setUp:155] Creating scope::collection _default FunctionCollection1 2021-11-21 22:58:27,216 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:948] Creating Collection default:_default:FunctionCollection1 2021-11-21 22:58:27,338 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/storage_base.py -> setUp():L160 2021-11-21 22:58:27,338 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:58:29,341 | test | INFO | MainThread | [storage_base:setUp:155] Creating scope::collection Scope1 FunctionCollection0 2021-11-21 22:58:29,342 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:948] Creating Collection default:Scope1:FunctionCollection0 2021-11-21 22:58:29,460 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/storage_base.py -> setUp():L160 2021-11-21 22:58:29,460 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:58:31,461 | test | INFO | MainThread | [storage_base:setUp:155] Creating scope::collection Scope1 FunctionCollection1 2021-11-21 22:58:31,463 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:948] Creating Collection default:Scope1:FunctionCollection1 2021-11-21 22:58:31,598 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/storage_base.py -> setUp():L160 2021-11-21 22:58:31,599 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-11-21 22:58:33,601 | test | DEBUG | MainThread | [storage_base:setUp:162] Collections list == ['FunctionCollection1', '_default'] 2021-11-21 22:58:33,602 | test | INFO | MainThread | [plasma_base:setUp:28] Creating SDK clients for client_pool 2021-11-21 22:58:33,604 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:36,757 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:37,493 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:38,173 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:38,881 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:39,561 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:40,217 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:40,858 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:41,427 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:42,118 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:42,775 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:43,315 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:43,855 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:44,476 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:45,088 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:45,747 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:46,421 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:47,048 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:47,625 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:48,292 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:245] Creating SDK connection for 'default' 2021-11-21 22:58:48,891 | test | DEBUG | MainThread | [storage_base:initial_load:550] initial_items_in_each_collection 200000 2021-11-21 22:58:48,990 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 22:58:48,994 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637564328.99 2021-11-21 22:58:48,994 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637564328.99' started 2021-11-21 22:58:48,996 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637564328.99 2021-11-21 22:58:49,338 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637564329.28 2021-11-21 22:58:49,341 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'PrintBucketStats_default_1637564329.28' started 2021-11-21 22:58:49,342 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24 2021-11-21 22:58:49,346 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24' started 2021-11-21 22:58:49,349 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24 2021-11-21 22:58:49,351 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24' started 2021-11-21 22:58:49,357 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24 2021-11-21 22:58:49,358 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24 2021-11-21 22:58:49,361 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24 2021-11-21 22:58:49,362 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24' started 2021-11-21 22:58:49,364 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24 2021-11-21 22:58:49,364 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24' started 2021-11-21 22:58:49,368 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24' started 2021-11-21 22:58:49,368 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24 2021-11-21 22:58:49,371 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25 2021-11-21 22:58:49,371 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24' started 2021-11-21 22:58:49,371 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25 2021-11-21 22:58:49,372 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24' started 2021-11-21 22:58:49,381 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:58:49,385 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25 2021-11-21 22:58:49,392 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:58:49,394 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25 2021-11-21 22:58:49,395 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:58:49,398 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25 2021-11-21 22:58:49,398 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25 2021-11-21 22:58:49,401 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25 2021-11-21 22:58:49,405 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25' started 2021-11-21 22:58:49,411 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25' started 2021-11-21 22:58:49,411 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25' started 2021-11-21 22:58:49,414 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25' started 2021-11-21 22:58:49,414 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25' started 2021-11-21 22:58:49,415 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25' started 2021-11-21 22:58:49,417 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25' started 2021-11-21 22:58:49,417 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25' started 2021-11-21 22:58:49,405 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25 2021-11-21 22:58:49,418 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25' started 2021-11-21 22:58:49,420 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25' started 2021-11-21 22:58:49,424 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25' started 2021-11-21 22:58:49,427 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25 2021-11-21 22:58:49,430 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:58:49,433 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25 2021-11-21 22:58:49,433 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25' started 2021-11-21 22:58:49,434 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:58:49,438 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25 2021-11-21 22:58:49,438 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25' started 2021-11-21 22:58:49,440 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:58:49,438 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25' started 2021-11-21 22:58:49,447 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25 2021-11-21 22:58:49,448 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25' started 2021-11-21 22:58:49,448 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26' started 2021-11-21 22:58:49,434 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25' started 2021-11-21 22:58:49,447 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25' started 2021-11-21 22:58:49,447 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25' started 2021-11-21 22:58:49,448 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 22:58:49,460 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26 2021-11-21 22:58:49,460 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26 2021-11-21 22:58:49,461 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 22:58:49,467 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 22:58:49,467 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26 2021-11-21 22:58:49,463 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26' started 2021-11-21 22:58:49,463 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26' started 2021-11-21 22:58:49,469 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 22:58:49,480 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26 2021-11-21 22:58:49,480 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 22:58:49,482 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26 2021-11-21 22:58:49,482 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 22:58:49,483 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 22:58:49,483 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 22:58:49,484 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 22:58:49,486 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 22:58:49,486 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26 2021-11-21 22:58:49,486 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26 2021-11-21 22:58:49,487 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26 2021-11-21 22:58:49,489 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 22:58:49,490 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 22:58:49,490 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 22:58:49,490 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27 2021-11-21 22:58:49,492 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27 2021-11-21 22:58:49,493 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 22:58:49,493 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27 2021-11-21 22:58:49,494 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 22:58:49,496 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 22:58:49,496 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 22:58:49,496 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 22:58:49,497 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 22:58:49,499 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 22:58:49,500 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 22:58:49,505 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 22:58:49,506 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 22:58:49,561 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 22:58:49,562 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 22:58:49,563 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 22:58:49,565 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 22:58:49,565 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 22:58:49,566 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 22:58:49,566 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 22:58:49,568 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 22:58:49,569 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27 2021-11-21 22:58:49,569 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 22:58:49,571 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 22:58:49,571 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27 2021-11-21 22:58:49,582 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 22:58:49,585 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27 2021-11-21 22:58:49,585 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28 2021-11-21 22:58:49,586 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28 2021-11-21 22:58:49,588 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 22:58:49,588 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28 2021-11-21 22:58:49,588 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 22:58:49,589 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 22:58:49,591 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 22:58:49,598 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24 2021-11-21 22:58:49,861 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 22:58:49,875 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:49,877 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:51,338 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 22:58:51,348 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:51,348 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:52,749 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 127.300000 2021-11-21 22:58:52,763 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:52,765 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:54,138 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:58:54,148 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:54,148 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:55,526 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:58:55,538 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:55,539 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:56,980 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:58:56,990 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:56,990 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:58,369 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:58:58,378 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:58,378 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:58:59,766 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:58:59,775 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:58:59,776 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:01,174 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 596.100000 2021-11-21 22:59:01,180 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:01,181 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:02,575 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 2476.100000 2021-11-21 22:59:02,585 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:02,585 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:03,994 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:04,005 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:04,006 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:05,392 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:05,400 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:05,401 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:06,763 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:06,770 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:06,772 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:08,197 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:08,204 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:08,206 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:09,680 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:09,690 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:09,693 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:11,137 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4110.400000 2021-11-21 22:59:11,144 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:11,145 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:12,542 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.100000 2021-11-21 22:59:12,549 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:12,551 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:13,993 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:14,000 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:14,003 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:15,539 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:15,546 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:15,548 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:16,947 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:16,954 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:16,956 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:18,344 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:18,351 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:18,352 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:19,789 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:19,796 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:19,796 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:21,211 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.400000 2021-11-21 22:59:21,217 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:21,219 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:22,595 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5951.300000 2021-11-21 22:59:22,627 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:22,628 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:24,068 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:24,076 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:24,078 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:25,451 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:25,460 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:25,460 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:26,937 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:26,946 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:26,947 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:28,341 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:28,349 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:28,351 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:29,785 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:29,792 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:29,792 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:31,217 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6112.700000 2021-11-21 22:59:31,223 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:31,226 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:32,644 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6346.800000 2021-11-21 22:59:32,653 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:32,654 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:34,061 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:34,068 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:34,069 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:35,483 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:35,490 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:35,492 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:36,917 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:36,924 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:36,926 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:38,365 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:38,374 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:38,375 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:38,528 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25' completed 2021-11-21 22:59:38,529 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26' started 2021-11-21 22:59:38,615 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26' completed 2021-11-21 22:59:38,617 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26' started 2021-11-21 22:59:38,654 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26' completed 2021-11-21 22:59:38,654 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26' started 2021-11-21 22:59:38,726 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25' completed 2021-11-21 22:59:38,726 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26' started 2021-11-21 22:59:38,812 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25' completed 2021-11-21 22:59:38,813 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26' started 2021-11-21 22:59:38,822 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24' completed 2021-11-21 22:59:38,822 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26' started 2021-11-21 22:59:38,848 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25' completed 2021-11-21 22:59:38,849 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26' started 2021-11-21 22:59:38,869 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25' completed 2021-11-21 22:59:38,871 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26' started 2021-11-21 22:59:38,874 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25' completed 2021-11-21 22:59:38,875 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26' started 2021-11-21 22:59:38,927 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25' completed 2021-11-21 22:59:38,930 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26' started 2021-11-21 22:59:38,990 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25' completed 2021-11-21 22:59:38,992 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26' started 2021-11-21 22:59:39,003 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24' completed 2021-11-21 22:59:39,003 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26' started 2021-11-21 22:59:39,009 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24' completed 2021-11-21 22:59:39,012 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26' started 2021-11-21 22:59:39,028 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25' completed 2021-11-21 22:59:39,029 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26' started 2021-11-21 22:59:39,048 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25' completed 2021-11-21 22:59:39,049 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26' started 2021-11-21 22:59:39,058 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25' completed 2021-11-21 22:59:39,059 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27' started 2021-11-21 22:59:39,104 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25' completed 2021-11-21 22:59:39,105 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27' started 2021-11-21 22:59:39,138 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25' completed 2021-11-21 22:59:39,138 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25' completed 2021-11-21 22:59:39,140 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27' started 2021-11-21 22:59:39,140 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27' started 2021-11-21 22:59:39,147 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24' completed 2021-11-21 22:59:39,147 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25' completed 2021-11-21 22:59:39,148 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27' started 2021-11-21 22:59:39,148 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27' started 2021-11-21 22:59:39,210 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25' completed 2021-11-21 22:59:39,211 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27' started 2021-11-21 22:59:39,237 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26' completed 2021-11-21 22:59:39,240 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27' started 2021-11-21 22:59:39,253 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25' completed 2021-11-21 22:59:39,255 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27' started 2021-11-21 22:59:39,322 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24' completed 2021-11-21 22:59:39,325 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27' started 2021-11-21 22:59:39,328 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24' completed 2021-11-21 22:59:39,331 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27' started 2021-11-21 22:59:39,331 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24 are 10000 2021-11-21 22:59:39,332 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 10000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24 2021-11-21 22:59:39,334 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24 2021-11-21 22:59:39,335 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24 are 10000 2021-11-21 22:59:39,335 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 10000 to 20000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24 2021-11-21 22:59:39,336 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24 2021-11-21 22:59:39,344 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25' completed 2021-11-21 22:59:39,345 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27' started 2021-11-21 22:59:39,440 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24' completed 2021-11-21 22:59:39,441 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27' started 2021-11-21 22:59:39,443 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24 are 10000 2021-11-21 22:59:39,444 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 20000 to 30000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24 2021-11-21 22:59:39,444 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24 2021-11-21 22:59:39,446 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24 are 10000 2021-11-21 22:59:39,447 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 30000 to 40000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24 2021-11-21 22:59:39,447 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24 2021-11-21 22:59:39,448 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24 are 10000 2021-11-21 22:59:39,450 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 40000 to 50000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24 2021-11-21 22:59:39,450 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24 2021-11-21 22:59:39,451 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24 are 10000 2021-11-21 22:59:39,453 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 50000 to 60000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24 2021-11-21 22:59:39,453 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24 2021-11-21 22:59:39,456 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24 are 10000 2021-11-21 22:59:39,457 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 60000 to 70000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24 2021-11-21 22:59:39,457 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25 2021-11-21 22:59:39,459 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25 are 10000 2021-11-21 22:59:39,460 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 10000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25 2021-11-21 22:59:39,460 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25 2021-11-21 22:59:39,461 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25 are 10000 2021-11-21 22:59:39,463 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 10000 to 20000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25 2021-11-21 22:59:39,463 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:59:39,464 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25 are 10000 2021-11-21 22:59:39,464 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 70000 to 80000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:59:39,466 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25 2021-11-21 22:59:39,467 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25 are 10000 2021-11-21 22:59:39,469 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 20000 to 30000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25 2021-11-21 22:59:39,470 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:59:39,470 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25 are 10000 2021-11-21 22:59:39,471 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 80000 to 90000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:59:39,473 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25 2021-11-21 22:59:39,473 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25 are 10000 2021-11-21 22:59:39,476 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 30000 to 40000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25 2021-11-21 22:59:39,477 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:59:39,479 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25 are 10000 2021-11-21 22:59:39,480 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 90000 to 100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:59:39,480 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25 2021-11-21 22:59:39,542 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25 are 10000 2021-11-21 22:59:39,542 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 40000 to 50000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25 2021-11-21 22:59:39,543 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25 2021-11-21 22:59:39,546 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25 are 10000 2021-11-21 22:59:39,546 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 50000 to 60000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25 2021-11-21 22:59:39,548 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25 2021-11-21 22:59:39,549 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25 are 10000 2021-11-21 22:59:39,549 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 100000 to 110000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25 2021-11-21 22:59:39,549 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25 2021-11-21 22:59:39,551 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25 are 10000 2021-11-21 22:59:39,552 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 60000 to 70000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25 2021-11-21 22:59:39,552 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25 2021-11-21 22:59:39,552 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25 are 10000 2021-11-21 22:59:39,553 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 110000 to 120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25 2021-11-21 22:59:39,553 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:59:39,555 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25 are 10000 2021-11-21 22:59:39,555 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 70000 to 80000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25 2021-11-21 22:59:39,555 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25 2021-11-21 22:59:39,556 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25 are 10000 2021-11-21 22:59:39,556 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 120000 to 130000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25 2021-11-21 22:59:39,558 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:59:39,559 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25 are 10000 2021-11-21 22:59:39,559 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 80000 to 90000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25 2021-11-21 22:59:39,559 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25 2021-11-21 22:59:39,561 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25 are 10000 2021-11-21 22:59:39,562 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 130000 to 140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25 2021-11-21 22:59:39,562 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:59:39,562 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25 are 10000 2021-11-21 22:59:39,563 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 90000 to 100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25 2021-11-21 22:59:39,565 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25 2021-11-21 22:59:39,565 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25 are 10000 2021-11-21 22:59:39,566 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 140000 to 150000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25 2021-11-21 22:59:39,568 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 22:59:39,569 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26 are 10000 2021-11-21 22:59:39,569 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 150000 to 160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 22:59:39,569 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26 2021-11-21 22:59:39,571 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26 are 10000 2021-11-21 22:59:39,572 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 100000 to 110000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26 2021-11-21 22:59:39,572 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26 2021-11-21 22:59:39,572 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26 are 10000 2021-11-21 22:59:39,573 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 110000 to 120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26 2021-11-21 22:59:39,575 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 22:59:39,828 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:39,835 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:39,836 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:41,367 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6584.000000 2021-11-21 22:59:41,375 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:41,377 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:42,851 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6565.700000 2021-11-21 22:59:42,871 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:42,885 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:44,358 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6590.000000 2021-11-21 22:59:44,365 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:44,365 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:45,788 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6590.000000 2021-11-21 22:59:45,796 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:45,796 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:47,233 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6590.000000 2021-11-21 22:59:47,243 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:47,244 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:48,703 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6590.000000 2021-11-21 22:59:48,710 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:48,710 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:50,187 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6590.000000 2021-11-21 22:59:50,196 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:50,197 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:51,625 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6531.500000 2021-11-21 22:59:51,631 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:51,634 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:53,095 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6531.500000 2021-11-21 22:59:53,101 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:53,102 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:54,546 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6425.900000 2021-11-21 22:59:54,553 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:54,555 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:55,999 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6425.900000 2021-11-21 22:59:56,006 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:56,009 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:57,470 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6425.900000 2021-11-21 22:59:57,476 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:57,477 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 22:59:58,950 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6425.900000 2021-11-21 22:59:58,957 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 22:59:58,959 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:00,473 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6425.900000 2021-11-21 23:00:00,507 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:00,509 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:01,950 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6554.300000 2021-11-21 23:00:01,959 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:01,960 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:03,417 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6554.300000 2021-11-21 23:00:03,428 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:03,430 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:04,871 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-21 23:00:04,878 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:04,880 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:06,312 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-21 23:00:06,319 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:06,319 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:07,709 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-21 23:00:07,716 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:07,717 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:09,167 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-21 23:00:09,173 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:09,174 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:10,584 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-21 23:00:10,592 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:10,592 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:12,038 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5931.000000 2021-11-21 23:00:12,045 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:12,046 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:13,453 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:13,459 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:13,460 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:14,913 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:14,918 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:14,920 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:16,405 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:16,413 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:16,414 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:17,834 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:17,841 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:17,842 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:19,305 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:19,312 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:19,312 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:20,723 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5542.100000 2021-11-21 23:00:20,730 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:20,732 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:22,217 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5783.600000 2021-11-21 23:00:22,223 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:22,223 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:23,686 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:23,693 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:23,694 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:24,349 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26' completed 2021-11-21 23:00:24,352 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27' started 2021-11-21 23:00:24,398 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26' completed 2021-11-21 23:00:24,401 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27' started 2021-11-21 23:00:24,401 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26' completed 2021-11-21 23:00:24,401 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27' started 2021-11-21 23:00:24,403 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26 are 10000 2021-11-21 23:00:24,404 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 160000 to 170000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 23:00:24,405 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 23:00:24,453 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26' completed 2021-11-21 23:00:24,454 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27' started 2021-11-21 23:00:24,519 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26' completed 2021-11-21 23:00:24,519 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27' started 2021-11-21 23:00:24,565 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26' completed 2021-11-21 23:00:24,566 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27' started 2021-11-21 23:00:24,576 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26' completed 2021-11-21 23:00:24,578 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27' started 2021-11-21 23:00:24,631 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26' completed 2021-11-21 23:00:24,634 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27' started 2021-11-21 23:00:24,657 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26' completed 2021-11-21 23:00:24,660 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27' started 2021-11-21 23:00:24,683 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26' completed 2021-11-21 23:00:24,684 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27' started 2021-11-21 23:00:24,696 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27' completed 2021-11-21 23:00:24,697 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27' started 2021-11-21 23:00:24,755 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26' completed 2021-11-21 23:00:24,756 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27' started 2021-11-21 23:00:24,813 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26' completed 2021-11-21 23:00:24,815 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27' started 2021-11-21 23:00:24,825 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27' completed 2021-11-21 23:00:24,825 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27' started 2021-11-21 23:00:24,838 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27' completed 2021-11-21 23:00:24,839 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26' completed 2021-11-21 23:00:24,839 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27' started 2021-11-21 23:00:24,841 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27' started 2021-11-21 23:00:24,875 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27' completed 2021-11-21 23:00:24,875 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27' started 2021-11-21 23:00:24,901 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27' completed 2021-11-21 23:00:24,901 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28' started 2021-11-21 23:00:24,914 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27' completed 2021-11-21 23:00:24,915 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28' started 2021-11-21 23:00:24,917 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26' completed 2021-11-21 23:00:24,918 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28' started 2021-11-21 23:00:24,920 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26 are 10000 2021-11-21 23:00:24,921 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 170000 to 180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 23:00:24,921 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26 2021-11-21 23:00:24,923 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26 are 10000 2021-11-21 23:00:24,924 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 120000 to 130000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26 2021-11-21 23:00:24,924 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 23:00:24,927 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26 are 10000 2021-11-21 23:00:24,927 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 180000 to 190000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 23:00:24,928 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26 2021-11-21 23:00:24,930 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26 are 10000 2021-11-21 23:00:24,930 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 130000 to 140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26 2021-11-21 23:00:24,931 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 23:00:24,933 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26 are 10000 2021-11-21 23:00:24,934 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 190000 to 200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 23:00:24,934 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26 2021-11-21 23:00:24,936 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26 are 10000 2021-11-21 23:00:24,937 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 140000 to 150000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26 2021-11-21 23:00:24,937 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 23:00:24,938 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26 are 10000 2021-11-21 23:00:24,940 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 150000 to 160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26 2021-11-21 23:00:24,940 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 23:00:24,940 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26 are 10000 2021-11-21 23:00:24,941 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 160000 to 170000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26 2021-11-21 23:00:24,943 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 23:00:24,944 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26 are 10000 2021-11-21 23:00:24,944 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 170000 to 180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26 2021-11-21 23:00:24,946 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 23:00:25,096 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26' completed 2021-11-21 23:00:25,098 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28' started 2021-11-21 23:00:25,108 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26 are 10000 2021-11-21 23:00:25,108 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 180000 to 190000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26 2021-11-21 23:00:25,109 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 23:00:25,111 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26 are 10000 2021-11-21 23:00:25,111 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 190000 to 200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26 2021-11-21 23:00:25,112 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26 2021-11-21 23:00:25,114 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26 are 10000 2021-11-21 23:00:25,114 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 10000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26 2021-11-21 23:00:25,115 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26 2021-11-21 23:00:25,115 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26 are 10000 2021-11-21 23:00:25,118 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 10000 to 20000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26 2021-11-21 23:00:25,118 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26 2021-11-21 23:00:25,118 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26 are 10000 2021-11-21 23:00:25,119 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 20000 to 30000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26 2021-11-21 23:00:25,119 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 23:00:25,121 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27 are 10000 2021-11-21 23:00:25,121 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 30000 to 40000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 23:00:25,122 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 23:00:25,124 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27 are 10000 2021-11-21 23:00:25,124 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:25,124 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 40000 to 50000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 23:00:25,125 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 23:00:25,125 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27 are 10000 2021-11-21 23:00:25,128 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 50000 to 60000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 23:00:25,128 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27 2021-11-21 23:00:25,130 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:25,131 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:25,229 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27' completed 2021-11-21 23:00:25,230 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28' started 2021-11-21 23:00:25,352 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27' completed 2021-11-21 23:00:25,354 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28' started 2021-11-21 23:00:25,423 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27' completed 2021-11-21 23:00:25,424 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28' started 2021-11-21 23:00:25,490 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27' completed 2021-11-21 23:00:25,530 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27' completed 2021-11-21 23:00:25,532 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27 are 10000 2021-11-21 23:00:25,533 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 10000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27 2021-11-21 23:00:25,535 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27 2021-11-21 23:00:25,536 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27 are 10000 2021-11-21 23:00:25,538 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 10000 to 20000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27 2021-11-21 23:00:25,539 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 23:00:25,539 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27 are 10000 2021-11-21 23:00:25,540 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 60000 to 70000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 23:00:25,542 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27 2021-11-21 23:00:25,542 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27 are 10000 2021-11-21 23:00:25,543 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 20000 to 30000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27 2021-11-21 23:00:25,545 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 23:00:25,546 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27 are 10000 2021-11-21 23:00:25,546 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 70000 to 80000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 23:00:25,546 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 23:00:25,749 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27' completed 2021-11-21 23:00:25,940 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27' completed 2021-11-21 23:00:25,941 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27 are 10000 2021-11-21 23:00:25,943 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 30000 to 40000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27 2021-11-21 23:00:25,944 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 23:00:25,946 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27 are 10000 2021-11-21 23:00:25,947 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 80000 to 90000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 23:00:25,947 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 23:00:25,948 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27 are 10000 2021-11-21 23:00:25,950 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 40000 to 50000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27 2021-11-21 23:00:25,950 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 23:00:25,951 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27 are 10000 2021-11-21 23:00:25,953 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 90000 to 100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 23:00:25,953 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 23:00:25,954 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27 are 10000 2021-11-21 23:00:25,954 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 50000 to 60000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27 2021-11-21 23:00:25,956 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 23:00:26,526 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:26,532 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:26,532 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:27,941 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:27,947 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:27,948 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:29,378 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:29,384 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:29,385 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:30,786 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5865.700000 2021-11-21 23:00:30,793 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:30,795 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:32,224 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5719.300000 2021-11-21 23:00:32,232 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:32,233 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:33,657 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:33,664 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:33,664 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:35,082 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:35,091 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:35,092 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:36,529 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:36,535 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:36,536 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:37,937 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:37,944 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:37,946 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:39,371 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:39,377 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:39,378 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:40,793 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5675.700000 2021-11-21 23:00:40,799 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:40,801 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:42,216 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5664.900000 2021-11-21 23:00:42,223 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:42,224 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:43,654 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:43,661 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:43,663 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:45,035 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:45,043 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:45,045 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:46,515 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:46,522 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:46,523 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:47,963 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:47,970 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:47,971 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:49,421 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:49,428 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:49,430 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:50,865 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5624.500000 2021-11-21 23:00:50,872 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:50,874 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:52,301 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5640.900000 2021-11-21 23:00:52,308 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:52,309 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:53,724 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:00:53,730 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:53,732 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:55,131 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:00:55,138 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:55,138 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:56,509 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:00:56,516 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:56,517 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:57,910 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:00:57,915 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:57,917 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:00:59,322 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:00:59,328 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:00:59,329 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:00,743 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5598.900000 2021-11-21 23:01:00,753 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:00,753 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:02,197 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5392.400000 2021-11-21 23:01:02,203 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:02,204 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:03,569 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5245.700000 2021-11-21 23:01:03,576 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:03,578 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:04,980 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5245.700000 2021-11-21 23:01:04,987 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:04,989 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:06,404 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5245.700000 2021-11-21 23:01:06,411 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:06,411 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:07,808 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5245.700000 2021-11-21 23:01:07,815 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:07,815 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:08,240 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27' completed 2021-11-21 23:01:08,243 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27 are 10000 2021-11-21 23:01:08,243 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 100000 to 110000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 23:01:08,244 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 23:01:08,289 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27' completed 2021-11-21 23:01:08,398 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27' completed 2021-11-21 23:01:08,400 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27 are 10000 2021-11-21 23:01:08,401 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 60000 to 70000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27 2021-11-21 23:01:08,401 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 23:01:08,403 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27 are 10000 2021-11-21 23:01:08,404 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 70000 to 80000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27 2021-11-21 23:01:08,404 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 23:01:08,625 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27' completed 2021-11-21 23:01:08,647 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27' completed 2021-11-21 23:01:08,720 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27' completed 2021-11-21 23:01:08,743 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28' completed 2021-11-21 23:01:08,785 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27' completed 2021-11-21 23:01:08,808 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27' completed 2021-11-21 23:01:08,816 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28' completed 2021-11-21 23:01:08,861 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27' completed 2021-11-21 23:01:08,898 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27' completed 2021-11-21 23:01:08,898 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27' completed 2021-11-21 23:01:08,917 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28' completed 2021-11-21 23:01:08,918 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27' completed 2021-11-21 23:01:08,934 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27' completed 2021-11-21 23:01:08,936 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27 are 10000 2021-11-21 23:01:08,937 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 110000 to 120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 23:01:08,937 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 23:01:08,938 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27 are 10000 2021-11-21 23:01:08,938 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 80000 to 90000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27 2021-11-21 23:01:08,940 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 23:01:08,948 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28' completed 2021-11-21 23:01:09,095 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27' completed 2021-11-21 23:01:09,098 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27 are 10000 2021-11-21 23:01:09,098 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 120000 to 130000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 23:01:09,099 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 23:01:09,101 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27 are 10000 2021-11-21 23:01:09,101 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27' completed 2021-11-21 23:01:09,102 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 90000 to 100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27 2021-11-21 23:01:09,104 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 23:01:09,105 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27 are 10000 2021-11-21 23:01:09,105 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 130000 to 140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 23:01:09,105 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 23:01:09,107 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27 are 10000 2021-11-21 23:01:09,108 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 100000 to 110000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27 2021-11-21 23:01:09,108 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 23:01:09,108 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27 are 10000 2021-11-21 23:01:09,109 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 140000 to 150000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 23:01:09,111 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 23:01:09,111 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27 are 10000 2021-11-21 23:01:09,111 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 110000 to 120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27 2021-11-21 23:01:09,111 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27' completed 2021-11-21 23:01:09,112 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27 2021-11-21 23:01:09,114 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27 are 10000 2021-11-21 23:01:09,115 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 150000 to 160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27 2021-11-21 23:01:09,115 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 23:01:09,117 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27 are 10000 2021-11-21 23:01:09,118 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 120000 to 130000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27 2021-11-21 23:01:09,118 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 23:01:09,118 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27 are 10000 2021-11-21 23:01:09,119 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 130000 to 140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27 2021-11-21 23:01:09,121 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27 2021-11-21 23:01:09,164 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28' completed 2021-11-21 23:01:09,196 | test | DEBUG | pool-3-thread-10 | [task:record_bucket_ops:3570] Ops rate for 'default': 5245.700000 2021-11-21 23:01:09,201 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:01:09,201 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:01:09,213 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28' completed 2021-11-21 23:01:09,276 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28' completed 2021-11-21 23:01:09,279 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27' completed 2021-11-21 23:01:09,279 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27 are 10000 2021-11-21 23:01:09,280 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 160000 to 170000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27 2021-11-21 23:01:09,282 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 23:01:09,282 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27 are 10000 2021-11-21 23:01:09,283 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 140000 to 150000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27 2021-11-21 23:01:09,285 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27 2021-11-21 23:01:09,285 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27 are 10000 2021-11-21 23:01:09,286 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 170000 to 180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27 2021-11-21 23:01:09,286 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28 2021-11-21 23:01:09,286 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28 are 10000 2021-11-21 23:01:09,288 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 150000 to 160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28 2021-11-21 23:01:09,288 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28 2021-11-21 23:01:09,289 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28 are 10000 2021-11-21 23:01:09,289 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 160000 to 170000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28 2021-11-21 23:01:09,289 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 23:01:09,290 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28 are 10000 2021-11-21 23:01:09,290 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 180000 to 190000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 23:01:09,292 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28 2021-11-21 23:01:09,292 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28 are 10000 2021-11-21 23:01:09,292 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 170000 to 180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28 2021-11-21 23:01:09,293 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 23:01:09,295 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28 are 10000 2021-11-21 23:01:09,295 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 190000 to 200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 23:01:09,296 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 23:01:09,296 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28 are 10000 2021-11-21 23:01:09,296 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 180000 to 190000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28 2021-11-21 23:01:09,298 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 23:01:09,299 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28 are 10000 2021-11-21 23:01:09,299 | test | DEBUG | pool-3-thread-9 | [task:execute_tasks:3915] Failed to load 0 docs from 190000 to 200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28 2021-11-21 23:01:09,299 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637564329.28 2021-11-21 23:01:10,210 | test | INFO | pool-3-thread-10 | [table_view:display:72] Ops trend for bucket 'default' +----------+------------------------------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+------------------------------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **.*........******............................*.........................******...........*............******.....*..******....*...*****X | 6584.000 | | 6565.700 | ..................................................................................................*.****X | 6590.000 | | 6531.500 | ..................................................................................................*X | 6531.500 | | 6425.900 | ................................................................................................*****..*X | 6554.300 | | 6541.100 | ..................................................................................................****X | 6541.100 | | 5931.000 | .........................................................................................X | 5931.000 | | 5542.100 | ...................................................................................******...*..*****X | 5865.700 | | 5719.300 | .....................................................................................X | 5719.300 | | 5675.700 | .....................................................................................*****X | 5675.700 | | 5664.900 | ....................................................................................X | 5664.900 | | 5624.500 | ....................................................................................******X | 5640.900 | | 5598.900 | ...................................................................................*****X | 5598.900 | | 5392.400 | ................................................................................X | 5392.400 | | 5245.700 | ..............................................................................****X | 5245.700 | +----------+------------------------------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:01:10,213 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637564329.28' completed 2021-11-21 23:01:10,214 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:01:10,216 | infra | WARNING | pool-3-thread-9 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637564328.99' not completed 2021-11-21 23:01:10,216 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:01:10,217 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,217 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,219 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,219 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,220 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,220 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,221 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.24' complete. Loaded 10000 items 2021-11-21 23:01:10,223 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_0_10000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,223 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_10000_20000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,224 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,224 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_20000_30000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,226 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,226 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_30000_40000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,227 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,227 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_40000_50000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,229 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_50000_60000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,230 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,230 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_60000_70000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,232 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,233 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_70000_80000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,233 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,233 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_80000_90000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,236 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,236 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_90000_100000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,237 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.25' complete. Loaded 10000 items 2021-11-21 23:01:10,239 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,240 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_100000_110000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,240 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_110000_120000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,240 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,242 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,243 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_120000_130000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,243 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,244 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_130000_140000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,246 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,246 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_140000_150000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,246 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_150000_160000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,247 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_160000_170000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,249 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_170000_180000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,250 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_180000_190000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,252 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default__default_ttl=0_create_NONE_190000_200000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,253 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_0_10000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,253 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_10000_20000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,255 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_20000_30000_1637564329.26' complete. Loaded 10000 items 2021-11-21 23:01:10,256 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_30000_40000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,256 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_40000_50000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,257 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_50000_60000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,259 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_0_10000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,259 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_10000_20000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,260 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_60000_70000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,260 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_20000_30000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,262 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_70000_80000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,263 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_30000_40000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,263 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_80000_90000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,265 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_40000_50000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,265 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_90000_100000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,266 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_50000_60000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,266 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_100000_110000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,266 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_60000_70000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,267 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_70000_80000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,267 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_110000_120000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,269 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_80000_90000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,269 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_120000_130000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,270 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_90000_100000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,272 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_130000_140000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,272 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_100000_110000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,273 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_140000_150000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,273 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_110000_120000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,275 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_150000_160000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,276 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_120000_130000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,276 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_130000_140000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,276 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_160000_170000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,278 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_140000_150000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,279 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_170000_180000_1637564329.27' complete. Loaded 10000 items 2021-11-21 23:01:10,279 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_150000_160000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,279 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_160000_170000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,280 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_180000_190000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,282 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_170000_180000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,282 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default__default_FunctionCollection1_ttl=0_create_NONE_190000_200000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,282 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_180000_190000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,283 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564328.99_default_Scope1_FunctionCollection0_ttl=0_create_NONE_190000_200000_1637564329.28' complete. Loaded 10000 items 2021-11-21 23:01:10,342 | infra | INFO | pool-3-thread-9 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637564470.29 2021-11-21 23:01:10,342 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'PrintBucketStats_default_1637564470.29' started 2021-11-21 23:01:10,344 | infra | DEBUG | pool-3-thread-9 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637564470.29 2021-11-21 23:01:10,345 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637564470.29' completed 2021-11-21 23:01:10,346 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:01:10,346 | infra | WARNING | pool-3-thread-9 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637564328.99' not completed 2021-11-21 23:01:10,348 | infra | DEBUG | pool-3-thread-9 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:01:10,348 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637564328.99' completed 2021-11-21 23:01:10,543 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:01:10,563 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:01:10,736 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:01:10,974 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:01:11,081 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:01:11,082 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:01:11,105 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:01:11,135 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:01:11,160 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:01:11,197 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:01:11,229 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:01:11,257 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:01:11,289 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:01:11,290 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637564471.29 2021-11-21 23:01:11,292 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637564471.29' started 2021-11-21 23:01:11,295 | infra | DEBUG | pool-3-thread-24 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:01:11,312 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:01:11,494 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:01:11,773 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:01:11,904 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:01:11,905 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:01:11,937 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:01:11,967 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:01:11,997 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:01:12,036 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:01:12,068 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:01:12,098 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:01:12,131 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:01:12,131 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637564472.13 2021-11-21 23:01:12,131 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637564472.13' started 2021-11-21 23:01:12,132 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637564471.29 2021-11-21 23:01:12,134 | infra | DEBUG | pool-3-thread-13 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:01:13,875 | test | DEBUG | pool-3-thread-24 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:01:13,877 | test | DEBUG | pool-3-thread-24 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:01:13,878 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637564471.29' completed 2021-11-21 23:01:13,880 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:01:13,881 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637564472.13 2021-11-21 23:01:14,619 | test | DEBUG | pool-3-thread-13 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:01:14,621 | test | DEBUG | pool-3-thread-13 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:01:14,621 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637564472.13' completed 2021-11-21 23:01:14,624 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:01:14,625 | test | INFO | MainThread | [plasma_stats:test_system_stability_with_indexer:612] Cluster ops test 2021-11-21 23:01:14,706 | test | DEBUG | MainThread | [GsiHelper_Rest:set_index_settings_internal:38] {'indexer.plasma.backIndex.enablePageBloomFilter': True, 'indexer.settings.rebalance.redistribute_indexes': True, 'indexer.settings.enable_corrupt_index_backup': True, 'indexer.plasma.mainIndex.enableInMemoryCompression': True, 'indexer.plasma.backIndex.enableInMemoryCompression': True} set 2021-11-21 23:01:14,790 | test | DEBUG | MainThread | [GsiHelper_Rest:set_index_settings_internal:38] {'indexer.plasma.backIndex.enablePageBloomFilter': True, 'indexer.settings.rebalance.redistribute_indexes': True, 'indexer.settings.enable_corrupt_index_backup': True, 'indexer.plasma.mainIndex.enableInMemoryCompression': True, 'indexer.plasma.backIndex.enableInMemoryCompression': True} set 2021-11-21 23:01:14,792 | test | INFO | MainThread | [index_ready_functions:create_gsi_on_each_collection:59] Creating indexes with defer:1 build 2021-11-21 23:01:14,793 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default_FunctionCollection1_0` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-21 23:01:14,795 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default_FunctionCollection1_0 2021-11-21 23:01:14,841 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_0` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.8' started 2021-11-21 23:01:14,841 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_0` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.8 2021-11-21 23:01:14,842 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default__default_0` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-21 23:01:14,844 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default__default_0 2021-11-21 23:01:14,907 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default__default_0` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.84 2021-11-21 23:01:14,907 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_0` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.84' started 2021-11-21 23:01:14,908 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection1_0` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-21 23:01:14,910 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection1_0 2021-11-21 23:01:14,915 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-21 23:01:14,961 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_0` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.91 2021-11-21 23:01:14,961 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_0` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.91' started 2021-11-21 23:01:14,963 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection0_0` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-21 23:01:14,963 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection0_0 2021-11-21 23:01:14,976 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call 2021-11-21 23:01:15,013 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-21 23:01:15,016 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_0` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.96 2021-11-21 23:01:15,016 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_0` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.96' started 2021-11-21 23:01:15,016 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_0` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.8 2021-11-21 23:01:15,061 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call 2021-11-21 23:01:15,312 | infra | DEBUG | pool-3-thread-25 | [task:call:6532] Status of the query 1 2021-11-21 23:01:15,313 | infra | INFO | pool-3-thread-25 | [task:call:6534] check isIndexQuery statusFalse 2021-11-21 23:01:15,313 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_0` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.84' completed 2021-11-21 23:01:16,229 | infra | DEBUG | pool-3-thread-7 | [task:call:6532] Status of the query 1 2021-11-21 23:01:16,230 | infra | INFO | pool-3-thread-7 | [task:call:6534] check isIndexQuery statusFalse 2021-11-21 23:01:16,230 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_0` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.96' completed 2021-11-21 23:02:15,221 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=CREATE+INDEX+%60default__default_FunctionCollection1_0%60+ON+%60default%60.%60_default%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+True%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "bd5cadda-5212-4226-b57a-4e6f961ec5a2", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index creation for index default__default_FunctionCollection1_0, bucket default, scope _default, collection FunctionCollection1 cannot start. Reason: Create index or Alter replica cannot proceed due to another concurrent create index request.. Scheduling of index creation was attempted. Please check for index status later."}], "status": "errors", "metrics": {"elapsedTime": "1m0.274261774s","executionTime": "1m0.273829554s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"errorCount": 1} } auth: Administrator:password 2021-11-21 23:02:15,227 | infra | DEBUG | pool-3-thread-28 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-21 23:02:15,230 | infra | DEBUG | pool-3-thread-28 | [task:call:6532] Status of the query 0 2021-11-21 23:02:15,230 | infra | INFO | pool-3-thread-28 | [task:call:6534] check isIndexQuery statusFalse 2021-11-21 23:02:15,230 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=CREATE+INDEX+%60default_Scope1_FunctionCollection1_0%60+ON+%60default%60.%60Scope1%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+True%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "4dd140b2-056c-4204-b607-d5fef148afcf", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index creation for index default_Scope1_FunctionCollection1_0, bucket default, scope Scope1, collection FunctionCollection1 cannot start. Reason: Create index or Alter replica cannot proceed due to another concurrent create index request.. Scheduling of index creation was attempted. Please check for index status later."}], "status": "errors", "metrics": {"elapsedTime": "1m0.197281994s","executionTime": "1m0.19703732s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"errorCount": 1} } auth: Administrator:password 2021-11-21 23:02:15,230 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_0` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.8' completed 2021-11-21 23:02:15,233 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default__default_0` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.84 2021-11-21 23:02:15,233 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_0` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.91 2021-11-21 23:02:15,236 | infra | DEBUG | pool-3-thread-19 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-21 23:02:15,236 | infra | DEBUG | pool-3-thread-19 | [task:call:6532] Status of the query 0 2021-11-21 23:02:15,237 | infra | INFO | pool-3-thread-19 | [task:call:6534] check isIndexQuery statusFalse 2021-11-21 23:02:15,237 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_0` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.91' completed 2021-11-21 23:02:15,239 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_0` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637564474.96 2021-11-21 23:02:15,378 | test | INFO | MainThread | [index_ready_functions:build_deferred_indexes:39] Building indexes 2021-11-21 23:02:15,380 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`_default`.`FunctionCollection1`(['default__default_FunctionCollection1_0']) USING GSI 2021-11-21 23:02:15,381 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60_default%60.%60FunctionCollection1%60%28%5B%27default__default_FunctionCollection1_0%27%5D%29+USING+GSI 2021-11-21 23:02:15,433 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'2d7e5381-6af5-4609-a1cd-2995e7201dbc', u'metrics': {u'resultCount': 0, u'executionTime': u'33.149823ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'33.317315ms'}, u'results': [], u'status': u'success'} 2021-11-21 23:02:15,434 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`_default`.`_default`(['default__default__default_0']) USING GSI 2021-11-21 23:02:15,434 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60_default%60.%60_default%60%28%5B%27default__default__default_0%27%5D%29+USING+GSI 2021-11-21 23:02:15,648 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'e9319ca8-344d-444c-8805-06391aabeea3', u'metrics': {u'resultCount': 0, u'executionTime': u'195.766011ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'195.923292ms'}, u'results': [], u'status': u'success'} 2021-11-21 23:02:15,650 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`Scope1`.`FunctionCollection1`(['default_Scope1_FunctionCollection1_0']) USING GSI 2021-11-21 23:02:15,651 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60Scope1%60.%60FunctionCollection1%60%28%5B%27default_Scope1_FunctionCollection1_0%27%5D%29+USING+GSI 2021-11-21 23:02:15,931 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'a35425b6-b52b-4fe3-a3f8-2db0f51c1a7f', u'metrics': {u'resultCount': 0, u'executionTime': u'263.689482ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'263.957951ms'}, u'results': [], u'status': u'success'} 2021-11-21 23:02:15,933 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`Scope1`.`FunctionCollection0`(['default_Scope1_FunctionCollection0_0']) USING GSI 2021-11-21 23:02:15,934 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60Scope1%60.%60FunctionCollection0%60%28%5B%27default_Scope1_FunctionCollection0_0%27%5D%29+USING+GSI 2021-11-21 23:02:15,983 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'5751d972-e383-435d-b9e6-05659583194e', u'metrics': {u'resultCount': 0, u'executionTime': u'30.642216ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'30.735188ms'}, u'results': [], u'status': u'success'} 2021-11-21 23:02:15,983 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-21 23:02:16,046 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default_FunctionCollection1_0 2021-11-21 23:02:16,115 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:16,115 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:17,117 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 0 2021-11-21 23:02:17,194 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:17,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:18,196 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 1 2021-11-21 23:02:18,256 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:18,257 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:19,259 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 2 2021-11-21 23:02:19,322 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:19,322 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:20,323 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 3 2021-11-21 23:02:20,381 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:20,381 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:21,382 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 4 2021-11-21 23:02:21,440 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:21,441 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:22,443 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 5 2021-11-21 23:02:22,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:22,502 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:23,503 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 6 2021-11-21 23:02:23,556 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:23,558 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:24,559 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 7 2021-11-21 23:02:24,621 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:24,622 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:25,624 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 8 2021-11-21 23:02:25,694 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:25,694 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:26,696 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 9 2021-11-21 23:02:26,767 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:26,769 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:27,769 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 10 2021-11-21 23:02:27,828 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:27,829 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:28,831 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 11 2021-11-21 23:02:28,891 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:28,892 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:29,894 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 12 2021-11-21 23:02:29,967 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-21 23:02:29,967 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:02:30,969 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_0 not found with iteration 13 2021-11-21 23:02:31,009 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-21 23:02:31,062 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default__default_0 2021-11-21 23:02:31,101 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-21 23:02:31,150 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection1_0 2021-11-21 23:02:31,188 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-21 23:02:31,226 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection0_0 2021-11-21 23:02:31,273 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:02:31,273 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:02:31,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:02:31,348 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:31,348 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:31,348 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:02:31,349 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:31,349 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:31,351 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:02:31,351 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:02:31,417 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:02:31,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:31,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:31,420 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:02:31,421 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:31,421 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:31,423 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:02:31,423 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:02:31,444 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:02:31,444 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:02:41,446 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:02:41,447 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:02:41,523 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:02:41,523 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:41,525 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:41,526 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:02:41,526 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:41,526 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:41,528 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:02:41,529 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:02:41,596 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:02:41,598 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:41,598 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:41,599 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:02:41,599 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:41,601 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:41,601 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:02:41,602 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:02:41,625 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:02:41,627 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:02:51,628 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:02:51,628 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:02:51,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:02:51,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:51,709 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:51,709 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:02:51,710 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:51,710 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:51,711 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:02:51,711 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:02:51,786 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:02:51,786 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:51,788 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:51,789 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:02:51,789 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:02:51,790 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:02:51,790 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:02:51,792 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:02:51,812 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:02:51,815 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:01,815 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:01,816 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:01,897 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:01,898 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:01,898 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:01,900 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:01,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:01,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:01,903 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:01,903 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:01,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:01,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:01,987 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:01,989 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:01,989 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:01,990 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:01,990 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:01,990 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:02,012 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:02,013 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:12,013 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:12,015 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:12,091 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:12,092 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:12,092 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:12,092 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:12,094 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:12,094 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:12,095 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:12,095 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:12,163 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:12,164 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:12,164 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:12,165 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:12,165 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:12,167 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:12,167 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:12,168 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:12,188 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:12,190 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:22,190 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:22,191 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:22,269 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:22,269 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:22,270 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:22,272 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:22,272 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:22,273 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:22,273 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:22,273 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:22,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:22,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:22,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:22,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:22,348 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:22,348 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:22,348 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:22,349 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:22,368 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:22,369 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:32,371 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:32,371 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:32,443 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:32,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:32,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:32,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:32,446 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:32,447 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:32,447 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:32,447 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:32,519 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:32,519 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:32,520 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:32,522 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:32,522 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:32,523 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:32,523 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:32,523 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:32,540 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:32,542 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:42,542 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:42,543 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:42,618 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:42,618 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:42,618 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:42,619 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:42,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:42,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:42,621 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:42,621 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:42,704 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:42,706 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:42,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:42,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:42,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:42,707 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:42,709 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:42,709 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:42,726 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:42,727 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:03:52,729 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:03:52,730 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:03:52,805 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:03:52,805 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:52,806 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:52,806 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:03:52,808 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:52,808 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:52,809 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:03:52,809 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:03:52,875 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:03:52,877 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:52,878 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:52,878 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:03:52,878 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:03:52,880 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:03:52,881 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:03:52,881 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:03:52,908 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:03:52,910 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:02,911 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:02,911 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:02,982 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:02,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:02,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:02,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:02,984 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:02,984 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:02,986 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:02,986 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:03,059 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:03,059 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:03,061 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:03,062 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:03,062 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:03,062 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:03,063 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:03,065 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:03,085 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:03,086 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:13,088 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:13,089 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:13,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:13,181 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:13,183 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:13,183 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:13,184 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:13,184 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:13,186 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:13,186 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:13,283 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:13,285 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:13,286 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:13,286 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:13,286 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:13,288 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:13,289 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:13,289 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:13,309 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:13,309 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:23,311 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:23,312 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:23,390 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:23,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:23,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:23,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:23,392 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:23,392 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:23,394 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:23,394 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:23,466 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:23,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:23,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:23,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:23,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:23,470 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:23,470 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:23,470 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:23,490 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:23,492 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:33,493 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:33,493 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:33,561 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:33,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:33,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:33,563 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:33,563 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:33,565 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:33,565 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:33,566 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:33,644 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:33,645 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:33,647 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:33,647 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:33,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:33,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:33,648 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:33,650 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:33,668 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:33,670 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:43,671 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:43,673 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:43,739 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:43,740 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:43,740 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:43,740 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:43,742 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:43,742 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:43,743 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:43,743 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:43,812 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:43,812 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:43,813 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:43,813 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:43,815 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:43,815 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:43,815 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:43,816 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:43,835 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:43,835 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:04:53,836 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:04:53,838 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:04:53,907 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:04:53,907 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:53,908 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:53,908 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:04:53,910 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:53,910 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:53,911 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:04:53,911 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:04:53,980 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:04:53,980 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:53,982 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:53,982 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:04:53,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:04:53,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:04:53,983 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:04:53,984 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:04:54,003 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:04:54,003 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:04,005 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:04,006 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:04,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:04,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:04,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:04,142 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:04,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:04,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:04,144 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:04,144 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:04,226 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:04,227 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:04,229 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:04,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:04,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:04,232 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:04,233 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:04,233 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:04,253 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:04,255 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:14,256 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:14,257 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:14,325 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:14,326 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:14,328 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:14,328 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:14,328 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:14,329 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:14,331 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:14,331 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:14,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:14,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:14,415 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:14,415 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:14,417 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:14,417 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:14,417 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:14,418 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:14,440 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:14,440 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:24,441 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:24,443 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:24,510 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:24,512 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:24,513 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:24,513 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:24,515 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:24,516 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:24,516 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:24,516 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:24,586 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:24,588 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:24,588 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:24,588 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:24,589 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:24,591 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:24,592 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:24,592 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:24,614 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:24,615 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:34,615 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:34,617 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:34,686 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:34,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:34,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:34,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:34,688 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:34,688 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:34,690 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:34,690 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:34,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:34,760 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:34,760 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:34,762 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:34,763 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:34,763 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:34,763 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:34,765 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:34,783 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:34,785 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:44,786 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:44,786 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:44,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:44,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:44,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:44,857 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:44,857 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:44,858 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:44,858 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:44,858 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:44,931 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:44,933 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:44,934 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:44,934 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:44,934 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:44,936 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:44,937 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:44,937 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:44,957 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:44,957 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:05:54,959 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:05:54,960 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:05:55,030 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:05:55,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:55,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:55,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:05:55,033 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:55,035 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:55,035 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:05:55,036 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:05:55,111 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:05:55,111 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:55,112 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:55,114 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:05:55,114 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:05:55,115 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:05:55,115 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:05:55,115 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:05:55,134 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:05:55,135 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:05,137 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:05,138 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:05,211 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:05,213 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:05,213 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:05,214 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:05,214 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:05,216 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:05,216 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:05,217 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:05,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:05,290 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:05,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:05,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:05,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:05,293 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:05,293 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:05,295 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:05,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:05,315 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:15,316 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:15,319 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:15,384 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:15,385 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:15,387 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:15,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:15,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:15,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:15,388 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:15,390 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:15,457 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:15,459 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:15,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:15,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:15,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:15,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:15,461 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:15,463 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:15,480 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:15,480 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:25,482 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:25,483 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:25,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:25,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:25,553 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:25,555 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:25,555 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:25,555 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:25,556 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:25,556 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:25,632 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:25,634 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:25,634 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:25,635 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:25,637 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:25,638 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:25,638 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:25,638 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:25,661 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:25,663 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:35,664 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:35,665 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:35,769 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:35,769 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:35,769 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:35,770 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:35,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:35,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:35,773 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:35,773 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:35,838 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:35,839 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:35,841 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:35,841 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:35,842 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:35,842 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:35,844 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:35,844 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:35,869 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:35,871 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:45,871 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:45,872 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:45,946 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:45,947 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:45,947 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:45,948 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:45,948 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:45,950 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:45,950 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:45,951 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:46,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:46,030 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:46,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:46,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:46,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:46,033 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:46,035 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:46,036 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:46,056 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:46,058 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:06:56,059 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:06:56,059 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:06:56,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:06:56,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:56,127 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:56,127 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:06:56,128 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:56,128 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:56,128 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:06:56,128 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:06:56,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:06:56,196 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:56,197 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:56,197 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:06:56,197 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:06:56,198 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:06:56,200 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:06:56,200 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:06:56,219 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:06:56,220 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:07:06,220 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:07:06,221 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:07:06,290 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:07:06,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:06,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:06,293 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:07:06,293 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:06,295 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:06,296 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:07:06,296 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:07:06,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:07:06,365 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:06,365 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:06,365 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:07:06,367 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:06,367 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:06,368 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:07:06,368 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:07:06,387 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:07:06,388 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:07:16,388 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:07:16,391 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:07:16,463 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:07:16,464 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:16,466 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:16,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:07:16,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:16,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:16,469 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:07:16,470 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:07:16,549 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:07:16,551 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:16,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:16,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:07:16,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:16,553 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:16,555 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:07:16,555 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:07:16,576 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:07:16,578 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:07:26,578 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:07:26,582 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:07:26,654 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:07:26,654 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:26,655 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:26,655 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:07:26,657 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:26,657 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:26,657 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:07:26,657 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:07:26,742 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:07:26,743 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:26,743 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:26,744 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:07:26,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:07:26,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:07:26,747 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:07:26,747 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:07:26,770 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:07:26,772 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:07:36,808 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:07:36,809 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637564856.81 2021-11-21 23:07:36,809 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637564856.81 2021-11-21 23:07:36,809 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637564856.81' started 2021-11-21 23:07:37,017 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637564856.98 2021-11-21 23:07:37,017 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'PrintBucketStats_default_1637564856.98' started 2021-11-21 23:07:37,019 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94 2021-11-21 23:07:37,019 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94' started 2021-11-21 23:07:37,019 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94 2021-11-21 23:07:37,020 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94 2021-11-21 23:07:37,020 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94' started 2021-11-21 23:07:37,023 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94 2021-11-21 23:07:37,026 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94 2021-11-21 23:07:37,020 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94' started 2021-11-21 23:07:37,023 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94' started 2021-11-21 23:07:37,026 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94' started 2021-11-21 23:07:37,026 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94 2021-11-21 23:07:37,032 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94 2021-11-21 23:07:37,032 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94' started 2021-11-21 23:07:37,029 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94' started 2021-11-21 23:07:37,036 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94' started 2021-11-21 23:07:37,033 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94 2021-11-21 23:07:37,048 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94 2021-11-21 23:07:37,049 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94 2021-11-21 23:07:37,048 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94' started 2021-11-21 23:07:37,049 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94' started 2021-11-21 23:07:37,049 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94' started 2021-11-21 23:07:37,049 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94 2021-11-21 23:07:37,056 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94 2021-11-21 23:07:37,059 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94 2021-11-21 23:07:37,059 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94 2021-11-21 23:07:37,059 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94 2021-11-21 23:07:37,061 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94 2021-11-21 23:07:37,062 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95 2021-11-21 23:07:37,062 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94' started 2021-11-21 23:07:37,061 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94' started 2021-11-21 23:07:37,062 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95 2021-11-21 23:07:37,065 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94' started 2021-11-21 23:07:37,068 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95' started 2021-11-21 23:07:37,065 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94' started 2021-11-21 23:07:37,068 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94' started 2021-11-21 23:07:37,068 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95' started 2021-11-21 23:07:37,073 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95' started 2021-11-21 23:07:37,072 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95 2021-11-21 23:07:37,092 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95 2021-11-21 23:07:37,094 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:07:37,092 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95' started 2021-11-21 23:07:37,094 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:07:37,095 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96' started 2021-11-21 23:07:37,094 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96' started 2021-11-21 23:07:37,095 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:07:37,096 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:07:37,095 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96' started 2021-11-21 23:07:37,098 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:07:37,098 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96' started 2021-11-21 23:07:37,098 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:07:37,098 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:07:37,099 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:07:37,101 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:07:37,101 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:07:37,099 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96' started 2021-11-21 23:07:37,101 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:07:37,102 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96' started 2021-11-21 23:07:37,104 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:07:37,102 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96' started 2021-11-21 23:07:37,105 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96' started 2021-11-21 23:07:37,104 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:07:37,107 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:07:37,107 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:07:37,108 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:07:37,108 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:07:37,109 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:07:37,109 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:07:37,111 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:07:37,111 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:07:37,111 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:07:37,112 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:07:37,118 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:07:37,118 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:07:37,118 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:07:37,119 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:07:37,121 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:07:37,121 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:07:37,121 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:07:37,122 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:07:37,124 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:07:37,125 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:07:37,125 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:07:37,125 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96 2021-11-21 23:07:37,127 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:07:37,128 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:07:37,128 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:07:37,128 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96 2021-11-21 23:07:37,130 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97 2021-11-21 23:07:37,131 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:07:37,131 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:07:37,132 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97 2021-11-21 23:07:37,134 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97 2021-11-21 23:07:37,134 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97 2021-11-21 23:07:37,135 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97 2021-11-21 23:07:37,137 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97 2021-11-21 23:07:37,138 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97 2021-11-21 23:07:37,138 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97 2021-11-21 23:07:37,140 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97 2021-11-21 23:07:37,141 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97 2021-11-21 23:07:37,141 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97 2021-11-21 23:07:37,141 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97 2021-11-21 23:07:37,142 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97 2021-11-21 23:07:37,144 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97 2021-11-21 23:07:37,144 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97 2021-11-21 23:07:37,144 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97 2021-11-21 23:07:37,145 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97 2021-11-21 23:07:37,147 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:07:37,148 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:07:37,148 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94 2021-11-21 23:07:37,479 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:07:37,503 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:37,503 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:38,964 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:07:38,971 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:38,973 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:40,443 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:07:40,448 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:40,450 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:41,884 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 1006.000000 2021-11-21 23:07:41,891 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:41,892 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:43,358 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 1006.000000 2021-11-21 23:07:43,365 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:43,365 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:44,779 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 2572.100000 2021-11-21 23:07:44,786 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:44,788 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:46,265 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 2572.100000 2021-11-21 23:07:46,272 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:46,273 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:47,707 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 2572.100000 2021-11-21 23:07:47,713 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:47,714 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:49,144 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 2572.100000 2021-11-21 23:07:49,151 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:49,151 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:50,664 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 2572.100000 2021-11-21 23:07:50,671 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:50,673 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:52,125 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4494.900000 2021-11-21 23:07:52,131 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:52,132 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:53,598 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:07:53,605 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:53,605 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:55,017 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:07:55,025 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:55,026 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:56,417 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:07:56,424 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:56,424 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:57,861 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:07:57,868 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:57,868 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:07:59,273 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:07:59,280 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:07:59,282 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:00,726 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5826.300000 2021-11-21 23:08:00,733 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:00,734 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:02,155 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5555.600000 2021-11-21 23:08:02,167 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:02,167 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:03,604 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:03,611 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:03,614 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:05,096 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:05,104 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:05,105 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:06,569 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:06,578 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:06,579 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:08,003 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:08,009 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:08,010 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:09,477 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:09,486 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:09,486 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:10,907 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5328.000000 2021-11-21 23:08:10,914 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:10,915 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:12,329 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5371.900000 2021-11-21 23:08:12,336 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:12,338 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:13,851 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:13,858 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:13,858 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:15,282 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:15,289 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:15,289 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:16,711 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:16,720 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:16,721 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:18,121 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:18,127 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:18,128 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:19,552 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:19,561 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:19,562 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:20,956 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5411.700000 2021-11-21 23:08:20,963 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:20,963 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:22,414 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5355.800000 2021-11-21 23:08:22,424 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:22,424 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:23,851 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:23,858 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:23,858 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:25,286 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:25,295 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:25,296 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:26,766 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:26,773 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:26,775 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:28,230 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:28,239 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:28,240 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:29,710 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:29,717 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:29,717 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:31,170 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5261.400000 2021-11-21 23:08:31,176 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:31,176 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:32,572 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5301.700000 2021-11-21 23:08:32,579 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:32,582 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:34,059 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:34,065 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:34,065 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:35,497 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:35,505 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:35,506 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:36,911 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:36,917 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:36,917 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:38,367 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:38,374 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:38,374 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:39,832 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:39,838 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:39,839 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:41,319 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5375.700000 2021-11-21 23:08:41,325 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:41,325 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:42,878 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5361.000000 2021-11-21 23:08:42,887 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:42,888 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:44,375 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5274.800000 2021-11-21 23:08:44,385 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:44,388 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:45,822 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5274.800000 2021-11-21 23:08:45,828 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:45,828 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:47,325 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5274.800000 2021-11-21 23:08:47,331 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:47,332 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:48,795 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5274.800000 2021-11-21 23:08:48,802 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:48,803 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:50,203 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5274.800000 2021-11-21 23:08:50,210 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:50,211 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:51,690 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5098.300000 2021-11-21 23:08:51,697 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:51,698 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:53,108 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5098.300000 2021-11-21 23:08:53,112 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:53,114 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:54,542 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4991.800000 2021-11-21 23:08:54,549 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:54,549 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:56,013 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4991.800000 2021-11-21 23:08:56,019 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:56,020 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:57,426 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4991.800000 2021-11-21 23:08:57,433 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:57,434 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:08:58,872 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4991.800000 2021-11-21 23:08:58,880 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:08:58,881 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:00,322 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4991.800000 2021-11-21 23:09:00,329 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:00,331 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:01,887 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.700000 2021-11-21 23:09:01,894 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:01,895 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:03,390 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.700000 2021-11-21 23:09:03,398 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:03,400 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:04,951 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4958.300000 2021-11-21 23:09:04,963 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:04,963 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:06,457 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4958.300000 2021-11-21 23:09:06,463 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:06,463 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:07,917 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4958.300000 2021-11-21 23:09:07,924 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:07,926 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:09,413 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4958.300000 2021-11-21 23:09:09,420 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:09,421 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:10,805 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4958.300000 2021-11-21 23:09:10,811 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:10,812 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:12,292 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4982.300000 2021-11-21 23:09:12,299 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:12,301 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:13,786 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:13,793 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:13,795 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:15,230 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:15,236 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:15,236 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:16,775 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:16,783 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:16,785 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:18,266 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:18,273 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:18,275 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:19,703 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:19,707 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:19,709 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:21,206 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5002.100000 2021-11-21 23:09:21,211 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:21,211 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:22,203 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94' completed 2021-11-21 23:09:22,204 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94' completed 2021-11-21 23:09:22,204 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96' started 2021-11-21 23:09:22,206 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96' started 2021-11-21 23:09:22,339 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94' completed 2021-11-21 23:09:22,342 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96' started 2021-11-21 23:09:22,390 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96' completed 2021-11-21 23:09:22,391 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96' started 2021-11-21 23:09:22,424 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94' completed 2021-11-21 23:09:22,424 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96' started 2021-11-21 23:09:22,551 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94' completed 2021-11-21 23:09:22,552 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96' started 2021-11-21 23:09:22,611 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94' completed 2021-11-21 23:09:22,612 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96' started 2021-11-21 23:09:22,642 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5199.700000 2021-11-21 23:09:22,648 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:22,650 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:22,698 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94' completed 2021-11-21 23:09:22,700 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96' started 2021-11-21 23:09:22,707 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94' completed 2021-11-21 23:09:22,707 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96' started 2021-11-21 23:09:22,740 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94' completed 2021-11-21 23:09:22,740 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96' started 2021-11-21 23:09:22,742 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94 are 20000 2021-11-21 23:09:22,743 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 200000 to 220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94 2021-11-21 23:09:22,743 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94 2021-11-21 23:09:22,762 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95' completed 2021-11-21 23:09:22,763 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94' completed 2021-11-21 23:09:22,763 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96' started 2021-11-21 23:09:22,763 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96' started 2021-11-21 23:09:22,786 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94' completed 2021-11-21 23:09:22,789 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96' started 2021-11-21 23:09:22,795 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95' completed 2021-11-21 23:09:22,796 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96' started 2021-11-21 23:09:22,801 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96' completed 2021-11-21 23:09:22,802 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96' started 2021-11-21 23:09:22,813 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95' completed 2021-11-21 23:09:22,815 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96' started 2021-11-21 23:09:22,852 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94' completed 2021-11-21 23:09:22,855 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96' started 2021-11-21 23:09:22,944 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96' completed 2021-11-21 23:09:22,946 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96' started 2021-11-21 23:09:23,019 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95' completed 2021-11-21 23:09:23,019 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96' started 2021-11-21 23:09:23,039 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94' completed 2021-11-21 23:09:23,040 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96' started 2021-11-21 23:09:23,105 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96' completed 2021-11-21 23:09:23,105 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96' started 2021-11-21 23:09:23,119 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96' completed 2021-11-21 23:09:23,121 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96' started 2021-11-21 23:09:23,151 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94' completed 2021-11-21 23:09:23,151 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96' started 2021-11-21 23:09:23,171 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96' completed 2021-11-21 23:09:23,173 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96' started 2021-11-21 23:09:23,253 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94' completed 2021-11-21 23:09:23,256 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96' started 2021-11-21 23:09:23,371 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96' completed 2021-11-21 23:09:23,371 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96' started 2021-11-21 23:09:23,390 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94' completed 2021-11-21 23:09:23,391 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96' started 2021-11-21 23:09:23,391 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94 are 20000 2021-11-21 23:09:23,392 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 220000 to 240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94 2021-11-21 23:09:23,394 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94 2021-11-21 23:09:23,394 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94 are 20000 2021-11-21 23:09:23,394 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 240000 to 260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94 2021-11-21 23:09:23,395 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94 2021-11-21 23:09:23,395 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94 are 20000 2021-11-21 23:09:23,397 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 260000 to 280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94 2021-11-21 23:09:23,398 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94 2021-11-21 23:09:23,398 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94 are 20000 2021-11-21 23:09:23,398 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 280000 to 300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94 2021-11-21 23:09:23,400 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94 2021-11-21 23:09:23,401 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94 are 20000 2021-11-21 23:09:23,401 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 300000 to 320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94 2021-11-21 23:09:23,403 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94 2021-11-21 23:09:23,404 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94 are 20000 2021-11-21 23:09:23,404 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 320000 to 340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94 2021-11-21 23:09:23,405 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94 2021-11-21 23:09:23,407 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94 are 20000 2021-11-21 23:09:23,407 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 340000 to 360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94 2021-11-21 23:09:23,408 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94 2021-11-21 23:09:23,410 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94 are 20000 2021-11-21 23:09:23,411 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 360000 to 380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94 2021-11-21 23:09:23,411 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94 2021-11-21 23:09:23,411 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94 are 20000 2021-11-21 23:09:23,413 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 380000 to 400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94 2021-11-21 23:09:23,414 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94 2021-11-21 23:09:23,414 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94 are 20000 2021-11-21 23:09:23,414 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 400000 to 420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94 2021-11-21 23:09:23,415 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94 2021-11-21 23:09:23,415 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94 are 20000 2021-11-21 23:09:23,417 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 420000 to 440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94 2021-11-21 23:09:23,417 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94 2021-11-21 23:09:23,418 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94 are 20000 2021-11-21 23:09:23,418 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 440000 to 460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94 2021-11-21 23:09:23,420 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94 2021-11-21 23:09:23,421 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94 are 20000 2021-11-21 23:09:23,421 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 460000 to 480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94 2021-11-21 23:09:23,423 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94 2021-11-21 23:09:23,424 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94 are 20000 2021-11-21 23:09:23,424 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 480000 to 500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94 2021-11-21 23:09:23,424 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94 2021-11-21 23:09:23,426 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94 are 20000 2021-11-21 23:09:23,427 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 500000 to 520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94 2021-11-21 23:09:23,427 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95 2021-11-21 23:09:23,428 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95 are 20000 2021-11-21 23:09:23,428 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 520000 to 540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95 2021-11-21 23:09:23,430 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95 2021-11-21 23:09:23,430 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95 are 20000 2021-11-21 23:09:23,431 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 540000 to 560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95 2021-11-21 23:09:23,433 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95 2021-11-21 23:09:23,433 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95 are 20000 2021-11-21 23:09:23,434 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 560000 to 580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95 2021-11-21 23:09:23,434 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95 2021-11-21 23:09:23,436 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95 are 20000 2021-11-21 23:09:23,437 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 580000 to 600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95 2021-11-21 23:09:23,437 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:09:23,438 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96 are 20000 2021-11-21 23:09:23,440 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 200000 to 220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:09:23,440 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:09:23,441 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96 are 20000 2021-11-21 23:09:23,441 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 200000 to 220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:09:23,443 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:09:23,444 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96 are 20000 2021-11-21 23:09:23,444 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 220000 to 240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:09:23,446 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:09:24,188 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:24,194 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:24,196 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:24,720 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96' completed 2021-11-21 23:09:24,721 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96' started 2021-11-21 23:09:24,723 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96 are 20000 2021-11-21 23:09:24,723 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 220000 to 240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96 2021-11-21 23:09:24,724 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:09:24,724 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96 are 20000 2021-11-21 23:09:24,726 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 240000 to 260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:09:24,726 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:09:24,727 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96 are 20000 2021-11-21 23:09:24,729 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 240000 to 260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96 2021-11-21 23:09:24,730 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:09:24,730 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96 are 20000 2021-11-21 23:09:24,733 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 260000 to 280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:09:24,733 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:09:24,734 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96 are 20000 2021-11-21 23:09:24,736 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 260000 to 280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96 2021-11-21 23:09:24,736 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:09:25,618 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:25,625 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:25,627 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:27,048 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:27,058 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:27,059 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:28,502 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:28,509 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:28,509 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:29,963 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:29,970 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:29,970 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:31,500 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5341.500000 2021-11-21 23:09:31,506 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:31,507 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:32,947 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5253.600000 2021-11-21 23:09:32,956 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:32,957 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:34,357 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5198.800000 2021-11-21 23:09:34,364 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:34,365 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:35,798 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5198.800000 2021-11-21 23:09:35,805 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:35,805 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:37,211 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5198.800000 2021-11-21 23:09:37,217 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:37,217 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:38,660 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5198.800000 2021-11-21 23:09:38,665 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:38,667 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:40,171 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5198.800000 2021-11-21 23:09:40,177 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:40,178 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:41,665 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5327.000000 2021-11-21 23:09:41,674 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:41,674 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:43,134 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5327.000000 2021-11-21 23:09:43,141 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:43,142 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:44,586 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5461.400000 2021-11-21 23:09:44,592 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:44,592 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:46,076 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5461.400000 2021-11-21 23:09:46,085 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:46,085 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:47,533 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5461.400000 2021-11-21 23:09:47,540 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:47,542 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:49,003 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5461.400000 2021-11-21 23:09:49,010 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:49,012 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:50,450 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5461.400000 2021-11-21 23:09:50,456 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:50,457 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:51,920 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5424.500000 2021-11-21 23:09:51,926 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:51,927 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:53,479 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:09:53,484 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:53,486 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:54,973 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:09:54,982 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:54,983 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:56,450 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:09:56,454 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:56,456 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:57,900 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:09:57,905 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:57,907 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:09:59,371 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:09:59,377 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:09:59,378 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:00,788 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.800000 2021-11-21 23:10:00,792 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:00,793 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:02,246 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5396.400000 2021-11-21 23:10:02,252 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:02,253 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:03,776 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:03,782 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:03,782 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:05,263 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:05,270 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:05,272 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:06,700 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:06,706 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:06,707 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:08,164 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:08,170 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:08,171 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:09,621 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:09,630 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:09,631 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:11,092 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5273.300000 2021-11-21 23:10:11,098 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:11,098 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:12,529 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5145.900000 2021-11-21 23:10:12,536 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:12,536 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:14,007 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:14,013 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:14,015 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:15,447 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:15,453 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:15,453 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:16,907 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:16,913 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:16,914 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:18,382 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:18,388 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:18,390 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:19,811 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:19,816 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:19,818 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:21,292 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5178.100000 2021-11-21 23:10:21,299 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:21,299 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:22,763 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5238.200000 2021-11-21 23:10:22,769 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:22,769 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:24,184 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5239.000000 2021-11-21 23:10:24,193 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:24,194 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:25,698 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5239.000000 2021-11-21 23:10:25,704 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:25,706 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:27,181 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5239.000000 2021-11-21 23:10:27,188 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:27,190 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:28,661 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5239.000000 2021-11-21 23:10:28,668 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:28,670 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:30,105 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5239.000000 2021-11-21 23:10:30,114 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:30,115 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:31,545 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5202.100000 2021-11-21 23:10:31,549 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:31,551 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:32,986 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5202.100000 2021-11-21 23:10:32,992 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:32,993 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:34,473 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5119.600000 2021-11-21 23:10:34,480 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:34,480 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:35,941 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5119.600000 2021-11-21 23:10:35,948 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:35,950 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:37,415 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5119.600000 2021-11-21 23:10:37,423 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:37,424 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:38,846 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5119.600000 2021-11-21 23:10:38,857 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:38,858 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:40,372 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5119.600000 2021-11-21 23:10:40,378 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:40,378 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:41,874 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4986.100000 2021-11-21 23:10:41,881 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:41,881 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:43,315 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4986.100000 2021-11-21 23:10:43,322 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:43,322 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:44,785 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4940.900000 2021-11-21 23:10:44,792 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:44,792 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:46,296 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4940.900000 2021-11-21 23:10:46,302 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:46,302 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:47,760 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4940.900000 2021-11-21 23:10:47,769 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:47,769 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:49,226 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4940.900000 2021-11-21 23:10:49,232 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:49,233 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:50,681 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4940.900000 2021-11-21 23:10:50,688 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:50,690 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:52,140 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4942.500000 2021-11-21 23:10:52,147 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:52,147 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:53,645 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:10:53,651 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:53,653 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:55,108 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:10:55,115 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:55,115 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:56,551 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:10:56,555 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:56,556 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:58,016 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:10:58,023 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:58,023 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:10:59,480 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:10:59,486 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:10:59,486 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:00,934 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4820.100000 2021-11-21 23:11:00,941 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:00,941 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:02,414 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4822.600000 2021-11-21 23:11:02,421 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:02,423 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:03,938 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:03,947 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:03,947 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:05,430 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:05,436 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:05,437 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:06,894 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:06,903 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:06,904 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:08,392 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:08,398 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:08,400 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:09,826 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:09,835 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:09,835 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:10,874 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96' completed 2021-11-21 23:11:10,875 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96' started 2021-11-21 23:11:10,881 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96' completed 2021-11-21 23:11:10,881 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96' started 2021-11-21 23:11:10,884 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96' completed 2021-11-21 23:11:10,884 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96' started 2021-11-21 23:11:10,888 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96' completed 2021-11-21 23:11:10,890 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97' started 2021-11-21 23:11:10,907 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96' completed 2021-11-21 23:11:10,908 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97' started 2021-11-21 23:11:10,960 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96' completed 2021-11-21 23:11:10,961 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97' started 2021-11-21 23:11:10,961 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96 are 20000 2021-11-21 23:11:10,963 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 280000 to 300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:11:10,964 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:11:10,966 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96 are 20000 2021-11-21 23:11:10,966 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 280000 to 300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96 2021-11-21 23:11:10,967 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:11:10,967 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96 are 20000 2021-11-21 23:11:10,967 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 300000 to 320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:11:10,969 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:11:11,029 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96' completed 2021-11-21 23:11:11,030 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97' started 2021-11-21 23:11:11,161 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96' completed 2021-11-21 23:11:11,163 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97' started 2021-11-21 23:11:11,253 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96' completed 2021-11-21 23:11:11,253 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97' started 2021-11-21 23:11:11,338 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.900000 2021-11-21 23:11:11,345 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:11,345 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:11,375 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96' completed 2021-11-21 23:11:11,377 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97' started 2021-11-21 23:11:11,377 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96 are 20000 2021-11-21 23:11:11,378 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 300000 to 320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96 2021-11-21 23:11:11,378 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:11:11,378 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96 are 20000 2021-11-21 23:11:11,380 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 320000 to 340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:11:11,380 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:11:11,384 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96' completed 2021-11-21 23:11:11,384 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97' started 2021-11-21 23:11:11,434 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96' completed 2021-11-21 23:11:11,436 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97' started 2021-11-21 23:11:11,493 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96' completed 2021-11-21 23:11:11,494 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97' started 2021-11-21 23:11:11,552 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96' completed 2021-11-21 23:11:11,553 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97' started 2021-11-21 23:11:11,575 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96' completed 2021-11-21 23:11:11,576 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97' started 2021-11-21 23:11:11,578 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96 are 20000 2021-11-21 23:11:11,578 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 340000 to 360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:11:11,578 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:11:11,686 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96' completed 2021-11-21 23:11:11,687 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97' started 2021-11-21 23:11:11,709 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96' completed 2021-11-21 23:11:11,710 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97' started 2021-11-21 23:11:11,710 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96 are 20000 2021-11-21 23:11:11,711 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 320000 to 340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96 2021-11-21 23:11:11,713 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:11:11,713 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96 are 20000 2021-11-21 23:11:11,713 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 360000 to 380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:11:11,713 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:11:11,786 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96' completed 2021-11-21 23:11:11,786 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97' started 2021-11-21 23:11:11,888 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96' completed 2021-11-21 23:11:11,890 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97' started 2021-11-21 23:11:11,890 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96 are 20000 2021-11-21 23:11:11,891 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 340000 to 360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96 2021-11-21 23:11:11,891 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:11:11,892 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96 are 20000 2021-11-21 23:11:11,892 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 380000 to 400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:11:11,894 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:11:11,950 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96' completed 2021-11-21 23:11:11,951 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97' started 2021-11-21 23:11:12,061 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96' completed 2021-11-21 23:11:12,062 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97' started 2021-11-21 23:11:12,153 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96' completed 2021-11-21 23:11:12,154 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97' started 2021-11-21 23:11:12,384 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96' completed 2021-11-21 23:11:12,385 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97' started 2021-11-21 23:11:12,532 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96' completed 2021-11-21 23:11:12,533 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97' started 2021-11-21 23:11:12,569 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96' completed 2021-11-21 23:11:12,648 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96' completed 2021-11-21 23:11:12,776 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96' completed 2021-11-21 23:11:12,778 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96 are 20000 2021-11-21 23:11:12,778 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 360000 to 380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96 2021-11-21 23:11:12,779 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:11:12,779 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96 are 20000 2021-11-21 23:11:12,779 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 400000 to 420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:11:12,780 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:11:12,782 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96 are 20000 2021-11-21 23:11:12,782 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 380000 to 400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96 2021-11-21 23:11:12,782 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:11:12,782 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96 are 20000 2021-11-21 23:11:12,783 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 420000 to 440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:11:12,785 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:11:12,785 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96 are 20000 2021-11-21 23:11:12,786 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 400000 to 420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96 2021-11-21 23:11:12,786 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:11:12,789 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96 are 20000 2021-11-21 23:11:12,789 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 440000 to 460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:11:12,789 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:11:12,790 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96 are 20000 2021-11-21 23:11:12,792 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 420000 to 440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96 2021-11-21 23:11:12,792 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:11:12,792 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96 are 20000 2021-11-21 23:11:12,792 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5019.500000 2021-11-21 23:11:12,792 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 460000 to 480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:11:12,795 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:11:12,796 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96 are 20000 2021-11-21 23:11:12,796 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 440000 to 460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96 2021-11-21 23:11:12,796 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:11:12,798 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96 are 20000 2021-11-21 23:11:12,798 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 480000 to 500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:11:12,799 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:11:12,799 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:12,799 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96 are 20000 2021-11-21 23:11:12,799 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:12,799 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 460000 to 480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96 2021-11-21 23:11:12,802 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:11:12,802 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96 are 20000 2021-11-21 23:11:12,803 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 500000 to 520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:11:12,803 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:11:12,805 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96 are 20000 2021-11-21 23:11:12,805 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 480000 to 500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96 2021-11-21 23:11:12,805 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:11:12,806 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96 are 20000 2021-11-21 23:11:12,806 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 520000 to 540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:11:12,808 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:11:12,808 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96 are 20000 2021-11-21 23:11:12,809 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 500000 to 520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96 2021-11-21 23:11:12,809 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:11:12,809 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96 are 20000 2021-11-21 23:11:12,811 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 540000 to 560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:11:12,811 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96 2021-11-21 23:11:12,812 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96 are 20000 2021-11-21 23:11:12,812 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 560000 to 580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96 2021-11-21 23:11:12,812 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:11:13,187 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96' completed 2021-11-21 23:11:13,188 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96 are 20000 2021-11-21 23:11:13,190 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 520000 to 540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96 2021-11-21 23:11:13,190 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:11:14,210 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.100000 2021-11-21 23:11:14,217 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:14,217 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:15,680 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.100000 2021-11-21 23:11:15,687 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:15,687 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:17,101 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.100000 2021-11-21 23:11:17,108 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:17,109 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:18,575 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.100000 2021-11-21 23:11:18,582 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:18,582 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:19,993 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.100000 2021-11-21 23:11:20,000 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:20,000 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:21,460 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4960.000000 2021-11-21 23:11:21,464 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:21,466 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:22,901 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4960.000000 2021-11-21 23:11:22,908 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:22,910 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:24,385 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4833.500000 2021-11-21 23:11:24,394 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:24,394 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:25,826 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4833.500000 2021-11-21 23:11:25,834 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:25,835 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:27,285 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4833.500000 2021-11-21 23:11:27,290 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:27,292 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:28,740 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4833.500000 2021-11-21 23:11:28,746 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:28,747 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:30,194 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4833.500000 2021-11-21 23:11:30,198 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:30,200 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:31,667 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4818.000000 2021-11-21 23:11:31,674 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:31,676 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:33,127 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4818.000000 2021-11-21 23:11:33,134 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:33,134 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:34,628 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4900.300000 2021-11-21 23:11:34,634 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:34,634 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:36,108 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4900.300000 2021-11-21 23:11:36,112 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:36,114 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:37,642 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4900.300000 2021-11-21 23:11:37,648 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:37,650 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:39,085 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4900.300000 2021-11-21 23:11:39,092 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:39,094 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:40,568 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4900.300000 2021-11-21 23:11:40,575 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:40,575 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:42,016 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5017.500000 2021-11-21 23:11:42,022 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:42,023 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:43,433 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:43,440 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:43,440 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:44,867 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:44,874 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:44,875 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:46,338 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:46,345 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:46,346 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:47,750 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:47,755 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:47,756 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:49,184 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:49,191 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:49,191 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:50,634 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5053.300000 2021-11-21 23:11:50,641 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:50,644 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:52,111 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.000000 2021-11-21 23:11:52,118 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:52,119 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:53,555 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:11:53,561 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:53,562 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:55,019 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:11:55,026 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:55,026 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:56,497 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:11:56,505 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:56,506 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:57,930 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:11:57,937 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:57,937 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:11:59,359 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:11:59,365 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:11:59,367 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:00,795 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 5099.900000 2021-11-21 23:12:00,801 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:00,802 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:02,210 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4942.500000 2021-11-21 23:12:02,216 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:02,216 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:03,681 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:03,687 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:03,687 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:05,107 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:05,112 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:05,114 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:06,615 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:06,621 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:06,621 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:08,056 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:08,063 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:08,065 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:09,523 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:09,529 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:09,530 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:10,989 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.000000 2021-11-21 23:12:10,994 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:10,996 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:12,444 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4824.200000 2021-11-21 23:12:12,450 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:12,451 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:13,944 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:13,948 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:13,950 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:15,384 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:15,391 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:15,392 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:16,836 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:16,842 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:16,844 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:18,338 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:18,345 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:18,345 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:19,782 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:19,789 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:19,790 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:21,282 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.300000 2021-11-21 23:12:21,288 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:21,289 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:22,733 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4835.500000 2021-11-21 23:12:22,740 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:22,740 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:24,165 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.800000 2021-11-21 23:12:24,171 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:24,173 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:25,618 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.800000 2021-11-21 23:12:25,625 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:25,625 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:27,072 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.800000 2021-11-21 23:12:27,078 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:27,078 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:28,582 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.800000 2021-11-21 23:12:28,595 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:28,595 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:30,085 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.800000 2021-11-21 23:12:30,092 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:30,095 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:31,543 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.800000 2021-11-21 23:12:31,551 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:31,551 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:33,035 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.800000 2021-11-21 23:12:33,042 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:33,042 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:34,525 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4733.900000 2021-11-21 23:12:34,530 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:34,532 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:36,002 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4733.900000 2021-11-21 23:12:36,006 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:36,007 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:37,470 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4733.900000 2021-11-21 23:12:37,477 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:37,479 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:38,884 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4733.900000 2021-11-21 23:12:38,890 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:38,891 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:40,305 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4733.900000 2021-11-21 23:12:40,312 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:40,312 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:41,736 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4698.700000 2021-11-21 23:12:41,742 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:41,742 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:43,157 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4698.700000 2021-11-21 23:12:43,163 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:43,164 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:44,625 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4556.700000 2021-11-21 23:12:44,631 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:44,631 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:46,102 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4556.700000 2021-11-21 23:12:46,108 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:46,108 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:47,549 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4556.700000 2021-11-21 23:12:47,555 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:47,555 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:48,980 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4556.700000 2021-11-21 23:12:48,986 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:48,986 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:49,934 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97' completed 2021-11-21 23:12:50,065 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96' completed 2021-11-21 23:12:50,065 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96 are 20000 2021-11-21 23:12:50,066 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 200000 to 220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96 2021-11-21 23:12:50,066 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:12:50,443 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4556.700000 2021-11-21 23:12:50,448 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:50,448 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:50,549 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97' completed 2021-11-21 23:12:50,734 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97' completed 2021-11-21 23:12:50,993 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97' completed 2021-11-21 23:12:51,000 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97' completed 2021-11-21 23:12:51,000 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97' completed 2021-11-21 23:12:51,072 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97' completed 2021-11-21 23:12:51,115 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97' completed 2021-11-21 23:12:51,357 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97' completed 2021-11-21 23:12:51,377 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97' completed 2021-11-21 23:12:51,453 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97' completed 2021-11-21 23:12:51,484 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97' completed 2021-11-21 23:12:51,512 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97' completed 2021-11-21 23:12:51,641 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97' completed 2021-11-21 23:12:51,641 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97' completed 2021-11-21 23:12:51,736 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97' completed 2021-11-21 23:12:51,805 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97' completed 2021-11-21 23:12:51,812 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97' completed 2021-11-21 23:12:51,851 | test | DEBUG | pool-3-thread-5 | [task:record_bucket_ops:3570] Ops rate for 'default': 4455.400000 2021-11-21 23:12:51,855 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:12:51,855 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:12:51,898 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97' completed 2021-11-21 23:12:51,926 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97' completed 2021-11-21 23:12:51,933 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96' completed 2021-11-21 23:12:51,934 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96 are 20000 2021-11-21 23:12:51,934 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 540000 to 560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96 2021-11-21 23:12:51,934 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96 2021-11-21 23:12:51,994 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97' completed 2021-11-21 23:12:52,244 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96' completed 2021-11-21 23:12:52,246 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96 are 20000 2021-11-21 23:12:52,246 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 580000 to 600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96 2021-11-21 23:12:52,246 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97 2021-11-21 23:12:52,247 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97 are 20000 2021-11-21 23:12:52,247 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 220000 to 240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97 2021-11-21 23:12:52,249 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:12:52,249 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97 are 20000 2021-11-21 23:12:52,250 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 560000 to 580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:12:52,250 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:12:52,252 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97 are 20000 2021-11-21 23:12:52,252 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 580000 to 600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:12:52,253 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97 2021-11-21 23:12:52,253 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97 are 20000 2021-11-21 23:12:52,253 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 240000 to 260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97 2021-11-21 23:12:52,253 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97 2021-11-21 23:12:52,255 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97 are 20000 2021-11-21 23:12:52,256 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 260000 to 280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97 2021-11-21 23:12:52,256 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97 2021-11-21 23:12:52,256 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97 are 20000 2021-11-21 23:12:52,256 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 280000 to 300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97 2021-11-21 23:12:52,257 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97 2021-11-21 23:12:52,257 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97 are 20000 2021-11-21 23:12:52,259 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 300000 to 320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97 2021-11-21 23:12:52,259 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97 2021-11-21 23:12:52,259 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97 are 20000 2021-11-21 23:12:52,259 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 320000 to 340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97 2021-11-21 23:12:52,260 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97 2021-11-21 23:12:52,260 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97 are 20000 2021-11-21 23:12:52,262 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 340000 to 360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97 2021-11-21 23:12:52,262 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97 2021-11-21 23:12:52,263 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97 are 20000 2021-11-21 23:12:52,263 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 360000 to 380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97 2021-11-21 23:12:52,263 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97 2021-11-21 23:12:52,265 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97 are 20000 2021-11-21 23:12:52,265 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 380000 to 400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97 2021-11-21 23:12:52,266 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97 2021-11-21 23:12:52,266 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97 are 20000 2021-11-21 23:12:52,266 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 400000 to 420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97 2021-11-21 23:12:52,266 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97 2021-11-21 23:12:52,267 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97 are 20000 2021-11-21 23:12:52,267 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 420000 to 440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97 2021-11-21 23:12:52,269 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97 2021-11-21 23:12:52,269 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97 are 20000 2021-11-21 23:12:52,269 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 440000 to 460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97 2021-11-21 23:12:52,270 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97 2021-11-21 23:12:52,270 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97 are 20000 2021-11-21 23:12:52,272 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 460000 to 480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97 2021-11-21 23:12:52,272 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97 2021-11-21 23:12:52,273 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97 are 20000 2021-11-21 23:12:52,273 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 480000 to 500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97 2021-11-21 23:12:52,273 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97 2021-11-21 23:12:52,275 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97 are 20000 2021-11-21 23:12:52,275 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 500000 to 520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97 2021-11-21 23:12:52,276 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97 2021-11-21 23:12:52,276 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97 are 20000 2021-11-21 23:12:52,276 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 520000 to 540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97 2021-11-21 23:12:52,278 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97 2021-11-21 23:12:52,278 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97 are 20000 2021-11-21 23:12:52,279 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 540000 to 560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97 2021-11-21 23:12:52,279 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:12:52,279 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97 are 20000 2021-11-21 23:12:52,280 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 560000 to 580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97 2021-11-21 23:12:52,280 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:12:52,282 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97 are 20000 2021-11-21 23:12:52,282 | test | DEBUG | pool-3-thread-26 | [task:execute_tasks:3915] Failed to load 0 docs from 580000 to 600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97 2021-11-21 23:12:52,282 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637564856.98 2021-11-21 23:12:52,865 | test | INFO | pool-3-thread-5 | [table_view:display:72] Ops trend for bucket 'default' +----------+-----------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-----------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | ***.................**...........................*****.................................*.......................*****X | 5826.300 | | 5555.600 | ..............................................................................................X | 5555.600 | | 5328.000 | ..........................................................................................******.******X | 5411.700 | | 5355.800 | ..........................................................................................X | 5355.800 | | 5261.400 | .........................................................................................*******..*****X | 5375.700 | | 5361.000 | ...........................................................................................X | 5361.000 | | 5274.800 | .........................................................................................****X | 5274.800 | | 5098.300 | ......................................................................................*X | 5098.300 | | 4991.800 | ....................................................................................****X | 4991.800 | | 4957.700 | ....................................................................................**************....*..*****X | 5341.500 | | 5253.600 | .........................................................................................X | 5253.600 | | 5198.800 | ........................................................................................*****..**..****X | 5461.400 | | 5424.500 | ............................................................................................X | 5424.500 | | 5396.800 | ...........................................................................................*****X | 5396.800 | | 5396.400 | ...........................................................................................X | 5396.400 | | 5273.300 | .........................................................................................*****X | 5273.300 | | 5145.900 | .......................................................................................*******.*****X | 5239.000 | | 5202.100 | ........................................................................................*X | 5202.100 | | 5119.600 | ......................................................................................****X | 5119.600 | | 4986.100 | ....................................................................................*X | 4986.100 | | 4940.900 | ...................................................................................*****X | 4942.500 | | 4820.100 | .................................................................................*******..******..*****X | 5046.100 | | 4960.000 | ....................................................................................*X | 4960.000 | | 4833.500 | .................................................................................****X | 4833.500 | | 4818.000 | .................................................................................**..*****..*******.******X | 5099.900 | | 4942.500 | ...................................................................................X | 4942.500 | | 4854.000 | ..................................................................................*****X | 4854.000 | | 4824.200 | .................................................................................X | 4824.200 | | 4813.300 | .................................................................................******X | 4835.500 | | 4830.800 | .................................................................................****X | 4830.800 | | 4755.800 | ................................................................................*X | 4755.800 | | 4733.900 | ................................................................................****X | 4733.900 | | 4698.700 | ...............................................................................*X | 4698.700 | | 4556.700 | .............................................................................****X | 4556.700 | | 4455.400 | ...........................................................................X | 4455.400 | +----------+-----------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:12:52,867 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637564856.98' completed 2021-11-21 23:12:52,868 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:12:52,868 | infra | WARNING | pool-3-thread-26 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637564856.81' not completed 2021-11-21 23:12:52,868 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:12:52,868 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,869 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,871 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,871 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,871 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,872 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,872 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,874 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,874 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,875 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,875 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,875 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,875 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,877 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,877 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,878 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.94' complete. Loaded 20000 items 2021-11-21 23:12:52,878 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.95' complete. Loaded 20000 items 2021-11-21 23:12:52,878 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.95' complete. Loaded 20000 items 2021-11-21 23:12:52,878 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.95' complete. Loaded 20000 items 2021-11-21 23:12:52,880 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.95' complete. Loaded 20000 items 2021-11-21 23:12:52,881 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_200000_220000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,881 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_200000_220000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,881 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_220000_240000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,881 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_220000_240000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,882 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_240000_260000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,882 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_240000_260000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,884 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_260000_280000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,884 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_260000_280000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,884 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_280000_300000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,884 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_280000_300000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,885 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_300000_320000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,887 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_300000_320000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,888 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_320000_340000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,888 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_340000_360000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,888 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_320000_340000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,888 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_360000_380000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,890 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_340000_360000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,891 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_380000_400000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,891 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_360000_380000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,891 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_400000_420000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,891 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_380000_400000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,892 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_420000_440000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,894 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_400000_420000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,894 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_440000_460000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,894 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_420000_440000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,894 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_460000_480000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,895 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_440000_460000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,895 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_480000_500000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,897 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_460000_480000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,897 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_500000_520000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,898 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_480000_500000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,898 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_520000_540000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,898 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_500000_520000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,898 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_540000_560000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,900 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_560000_580000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,900 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_520000_540000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,901 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_200000_220000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,901 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_540000_560000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,901 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection1_ttl=0_create_NONE_580000_600000_1637564856.96' complete. Loaded 20000 items 2021-11-21 23:12:52,901 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_220000_240000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,903 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_560000_580000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,903 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default_Scope1_FunctionCollection0_ttl=0_create_NONE_580000_600000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,904 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_240000_260000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,904 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_260000_280000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,904 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_280000_300000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,905 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_300000_320000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,905 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_320000_340000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,907 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_340000_360000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,907 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_360000_380000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,907 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_380000_400000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,907 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_400000_420000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,908 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_420000_440000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,908 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_440000_460000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,908 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_460000_480000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,910 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_480000_500000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,910 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_500000_520000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,911 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_520000_540000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,911 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_540000_560000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,911 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_560000_580000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,911 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637564856.81_default__default__default_ttl=0_create_NONE_580000_600000_1637564856.97' complete. Loaded 20000 items 2021-11-21 23:12:52,951 | infra | INFO | pool-3-thread-26 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637565172.91 2021-11-21 23:12:52,951 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'PrintBucketStats_default_1637565172.91' started 2021-11-21 23:12:52,953 | infra | DEBUG | pool-3-thread-26 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637565172.91 2021-11-21 23:12:52,954 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637565172.91' completed 2021-11-21 23:12:52,956 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:12:52,956 | infra | WARNING | pool-3-thread-26 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637564856.81' not completed 2021-11-21 23:12:52,957 | infra | DEBUG | pool-3-thread-26 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:12:52,957 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637564856.81' completed 2021-11-21 23:12:53,142 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:12:53,157 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:12:53,428 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:12:53,716 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:12:53,858 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:12:53,859 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:12:53,891 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:12:53,927 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:12:53,956 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:12:53,993 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:12:54,023 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:12:54,053 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:12:54,085 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:12:54,086 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637565174.09 2021-11-21 23:12:54,086 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565174.09' started 2021-11-21 23:12:54,088 | infra | DEBUG | pool-3-thread-20 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:12:54,105 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:12:54,372 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:12:54,653 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:12:54,795 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:12:54,796 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:12:54,825 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:12:54,851 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:12:54,875 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:12:54,911 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:12:54,944 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:12:54,977 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:12:55,012 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:12:55,013 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637565175.01 2021-11-21 23:12:55,013 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565175.01' started 2021-11-21 23:12:55,013 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637565174.09 2021-11-21 23:12:55,015 | infra | DEBUG | pool-3-thread-10 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:12:56,796 | test | DEBUG | pool-3-thread-20 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:12:56,798 | test | DEBUG | pool-3-thread-20 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:12:56,799 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565174.09' completed 2021-11-21 23:12:56,799 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:12:56,801 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637565175.01 2021-11-21 23:12:57,700 | test | DEBUG | pool-3-thread-10 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:12:57,700 | test | DEBUG | pool-3-thread-10 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:12:57,700 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565175.01' completed 2021-11-21 23:12:57,701 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:12:57,703 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:642] Added items from 200000 to 600000 2021-11-21 23:12:57,704 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:12:57,704 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:12:57,776 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:12:57,778 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:12:57,778 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:12:57,779 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:12:57,779 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:12:57,779 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:12:57,779 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:12:57,780 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:12:57,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:12:57,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:12:57,849 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:12:57,849 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:12:57,849 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:12:57,851 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:12:57,851 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:12:57,851 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:12:57,869 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:12:57,871 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:07,871 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:07,872 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:07,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:07,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:07,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:07,964 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:07,964 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:07,966 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:07,967 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:07,967 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:08,042 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:08,042 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:08,043 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:08,043 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:08,045 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:08,046 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:08,046 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:08,046 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:08,065 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:08,065 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:18,066 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:18,068 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:18,138 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:18,138 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:18,140 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:18,140 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:18,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:18,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:18,141 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:18,142 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:18,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:18,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:18,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:18,224 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:18,226 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:18,226 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:18,226 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:18,226 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:18,243 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:18,244 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:28,246 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:28,246 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:28,322 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:28,323 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:28,323 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:28,325 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:28,325 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:28,325 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:28,325 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:28,326 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:28,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:28,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:28,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:28,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:28,392 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:28,392 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:28,394 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:28,394 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:28,411 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:28,411 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:38,413 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:38,413 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:38,480 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:38,482 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:38,482 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:38,483 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:38,483 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:38,483 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:38,483 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:38,484 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:38,549 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:38,551 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:38,551 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:38,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:38,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:38,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:38,553 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:38,553 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:38,571 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:38,572 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:48,572 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:48,573 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:48,634 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:48,634 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:48,635 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:48,635 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:48,637 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:48,637 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:48,638 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:48,638 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:48,710 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:48,711 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:48,711 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:48,713 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:48,713 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:48,713 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:48,714 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:48,714 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:48,733 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:48,733 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:13:58,734 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:13:58,736 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:13:58,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:13:58,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:58,803 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:58,803 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:13:58,805 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:58,805 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:58,805 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:13:58,805 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:13:58,900 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:13:58,900 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:58,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:58,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:13:58,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:13:58,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:13:58,903 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:13:58,903 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:13:58,920 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:13:58,921 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:08,923 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:08,923 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:08,993 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:08,993 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:08,993 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:08,994 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:08,994 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:08,996 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:08,996 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:08,996 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:09,069 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:09,071 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:09,071 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:09,072 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:09,072 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:09,072 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:09,073 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:09,073 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:09,092 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:09,092 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:19,094 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:19,095 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:19,165 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:19,165 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:19,167 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:19,167 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:19,167 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:19,168 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:19,168 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:19,170 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:19,242 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:19,243 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:19,243 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:19,243 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:19,243 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:19,244 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:19,246 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:19,246 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:19,263 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:19,263 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:29,265 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:29,266 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:29,336 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:29,336 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:29,338 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:29,338 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:29,338 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:29,339 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:29,339 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:29,341 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:29,407 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:29,407 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:29,408 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:29,408 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:29,410 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:29,410 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:29,411 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:29,411 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:29,430 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:29,430 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:39,430 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:39,431 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:39,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:39,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:39,502 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:39,502 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:39,503 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:39,503 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:39,503 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:39,505 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:39,572 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:39,572 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:39,572 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:39,573 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:39,573 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:39,575 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:39,575 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:39,575 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:39,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:39,594 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:49,595 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:49,595 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:49,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:49,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:49,663 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:49,663 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:49,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:49,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:49,664 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:49,664 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:49,734 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:49,734 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:49,736 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:49,736 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:49,736 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:49,737 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:49,737 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:49,739 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:49,757 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:49,757 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:14:59,759 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:14:59,759 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:14:59,857 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:14:59,857 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:59,858 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:59,858 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:14:59,858 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:59,858 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:59,859 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:14:59,859 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:14:59,927 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:14:59,927 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:59,927 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:59,927 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:14:59,928 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:14:59,928 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:14:59,930 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:14:59,930 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:14:59,948 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:14:59,948 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:15:09,950 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:15:09,950 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:15:10,019 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:15:10,019 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:10,019 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:10,020 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:15:10,020 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:10,022 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:10,023 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:15:10,023 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:15:10,092 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:15:10,094 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:10,095 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:10,095 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:15:10,095 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:10,096 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:10,096 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:15:10,098 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:15:10,115 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:15:10,115 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:15:20,117 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:15:20,118 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:15:20,191 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:15:20,193 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:20,193 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:20,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:15:20,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:20,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:20,196 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:15:20,196 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:15:20,267 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:15:20,269 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:20,269 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:20,269 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:15:20,270 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:20,270 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:20,272 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:15:20,273 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:15:20,289 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:15:20,290 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:15:30,292 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:15:30,292 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:15:30,358 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:15:30,359 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:30,359 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:30,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:15:30,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:30,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:30,361 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:15:30,362 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:15:30,430 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:15:30,431 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:30,431 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:30,433 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:15:30,433 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:30,434 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:30,434 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:15:30,434 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:15:30,451 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:15:30,453 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:15:40,453 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:15:40,454 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:15:40,526 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:15:40,526 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:40,528 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:40,528 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:15:40,528 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:40,529 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:40,529 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:15:40,529 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:15:40,598 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:15:40,598 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:40,598 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:40,599 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:15:40,599 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:40,601 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:40,601 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:15:40,602 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:15:40,619 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:15:40,621 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:15:50,621 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:15:50,622 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:15:50,697 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:15:50,697 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:50,697 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:50,698 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:15:50,698 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:50,700 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:50,700 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:15:50,700 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:15:50,770 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:15:50,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:50,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:50,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:15:50,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:15:50,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:15:50,775 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:15:50,775 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:15:50,792 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:15:50,793 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:00,795 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:00,795 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:00,859 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:00,859 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:00,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:00,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:00,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:00,862 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:00,862 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:00,864 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:00,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:00,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:00,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:00,961 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:00,961 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:00,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:00,963 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:00,963 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:00,984 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:00,984 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:10,986 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:10,987 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:11,055 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:11,056 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:11,056 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:11,058 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:11,058 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:11,059 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:11,059 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:11,059 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:11,131 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:11,132 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:11,132 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:11,132 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:11,134 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:11,134 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:11,134 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:11,134 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:11,151 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:11,151 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:21,153 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:21,153 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:21,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:21,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:21,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:21,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:21,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:21,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:21,221 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:21,221 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:21,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:21,290 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:21,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:21,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:21,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:21,292 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:21,293 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:21,293 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:21,312 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:21,312 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:31,313 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:31,315 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:31,375 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:31,377 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:31,377 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:31,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:31,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:31,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:31,378 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:31,380 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:31,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:31,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:31,446 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:31,446 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:31,447 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:31,447 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:31,447 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:31,447 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:31,464 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:31,466 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:41,467 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:41,467 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:41,532 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:41,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:41,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:41,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:41,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:41,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:41,536 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:41,536 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:41,605 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:41,605 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:41,607 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:41,607 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:41,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:41,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:41,608 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:41,609 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:41,627 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:41,627 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:16:51,628 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:16:51,628 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:16:51,691 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:16:51,691 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:51,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:51,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:16:51,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:51,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:51,694 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:16:51,694 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:16:51,770 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:16:51,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:51,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:51,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:16:51,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:16:51,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:16:51,773 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:16:51,775 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:16:51,793 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:16:51,795 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:01,796 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:01,796 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:01,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:01,862 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:01,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:01,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:01,865 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:01,865 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:01,865 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:01,867 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:01,934 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:01,936 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:01,936 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:01,937 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:01,937 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:01,937 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:01,937 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:01,938 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:01,954 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:01,954 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:11,956 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:11,957 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:12,023 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:12,025 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:12,025 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:12,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:12,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:12,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:12,026 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:12,028 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:12,098 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:12,099 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:12,099 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:12,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:12,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:12,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:12,102 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:12,104 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:12,122 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:12,124 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:22,125 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:22,125 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:22,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:22,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:22,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:22,196 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:22,196 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:22,197 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:22,197 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:22,197 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:22,279 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:22,279 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:22,280 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:22,280 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:22,282 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:22,282 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:22,282 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:22,282 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:22,301 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:22,301 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:32,302 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:32,302 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:32,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:32,390 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:32,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:32,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:32,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:32,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:32,392 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:32,392 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:32,466 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:32,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:32,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:32,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:32,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:32,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:32,470 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:32,470 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:32,486 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:32,487 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:42,489 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:42,490 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:42,582 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:42,584 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:42,584 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:42,584 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:42,585 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:42,585 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:42,585 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:42,585 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:42,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:42,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:42,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:42,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:42,665 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:42,665 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:42,667 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:42,667 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:42,684 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:42,684 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:17:52,684 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:17:52,686 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:17:52,756 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:17:52,756 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:52,757 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:52,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:17:52,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:52,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:52,759 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:17:52,760 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:17:52,834 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:17:52,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:52,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:52,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:17:52,836 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:17:52,838 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:17:52,838 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:17:52,838 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:17:52,861 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:17:52,861 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:18:02,891 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:18:02,891 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637565482.89 2021-11-21 23:18:02,892 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637565482.89' started 2021-11-21 23:18:02,892 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637565482.89 2021-11-21 23:18:03,032 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637565482.99 2021-11-21 23:18:03,033 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'PrintBucketStats_default_1637565482.99' started 2021-11-21 23:18:03,033 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97 2021-11-21 23:18:03,035 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97' started 2021-11-21 23:18:03,035 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:18:03,035 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98' started 2021-11-21 23:18:03,036 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' started 2021-11-21 23:18:03,038 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:18:03,040 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:18:03,042 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98' started 2021-11-21 23:18:03,042 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:18:03,042 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98' started 2021-11-21 23:18:03,043 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:18:03,043 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' started 2021-11-21 23:18:03,046 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:18:03,046 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98' started 2021-11-21 23:18:03,051 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:18:03,051 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' started 2021-11-21 23:18:03,053 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:18:03,053 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98' started 2021-11-21 23:18:03,055 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:18:03,056 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' started 2021-11-21 23:18:03,058 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:18:03,058 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98' started 2021-11-21 23:18:03,059 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:18:03,059 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' started 2021-11-21 23:18:03,062 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:18:03,062 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98' started 2021-11-21 23:18:03,065 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:18:03,066 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:18:03,068 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98' started 2021-11-21 23:18:03,068 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:18:03,068 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98' started 2021-11-21 23:18:03,071 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:18:03,073 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:18:03,073 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98' started 2021-11-21 23:18:03,065 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' started 2021-11-21 23:18:03,072 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' started 2021-11-21 23:18:03,073 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:18:03,075 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' started 2021-11-21 23:18:03,078 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:18:03,078 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:18:03,079 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:18:03,081 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:18:03,081 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98' started 2021-11-21 23:18:03,082 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:18:03,082 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' started 2021-11-21 23:18:03,082 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:18:03,082 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98' started 2021-11-21 23:18:03,084 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:18:03,082 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98' started 2021-11-21 23:18:03,085 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98' started 2021-11-21 23:18:03,084 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' started 2021-11-21 23:18:03,085 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' started 2021-11-21 23:18:03,085 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98' started 2021-11-21 23:18:03,085 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:18:03,086 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:18:03,086 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' started 2021-11-21 23:18:03,086 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:18:03,088 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:18:03,095 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:18:03,095 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:18:03,096 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:18:03,098 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:18:03,098 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:18:03,101 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:18:03,101 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:18:03,101 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:18:03,102 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:18:03,104 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:18:03,107 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:18:03,108 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:18:03,108 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:18:03,108 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:18:03,109 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:18:03,111 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:18:03,111 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:18:03,111 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:18:03,111 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:18:03,112 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:18:03,114 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:18:03,114 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:18:03,115 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:18:03,115 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:18:03,115 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:18:03,118 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99 2021-11-21 23:18:03,118 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:18:03,119 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99 2021-11-21 23:18:03,121 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:18:03,121 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:18:03,122 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99 2021-11-21 23:18:03,124 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:18:03,125 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99 2021-11-21 23:18:03,125 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:18:03,127 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99 2021-11-21 23:18:03,128 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:18:03,128 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99 2021-11-21 23:18:03,130 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:18:03,131 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:18:03,131 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99 2021-11-21 23:18:03,134 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99 2021-11-21 23:18:03,134 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99 2021-11-21 23:18:03,134 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:18:03,135 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:18:03,135 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:18:03,138 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:18:03,138 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:18:03,138 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:18:03,141 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:18:03,141 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:18:03,141 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97 2021-11-21 23:18:03,473 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:03,480 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:03,480 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:04,971 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:04,977 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:04,979 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:06,480 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:06,486 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:06,486 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:07,992 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:07,996 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:07,997 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:09,436 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:09,443 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:09,444 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:10,855 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:18:10,861 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:10,861 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:12,318 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 2085.500000 2021-11-21 23:18:12,325 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:12,325 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:13,865 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:13,871 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:13,872 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:15,292 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:15,299 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:15,301 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:16,763 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:16,769 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:16,770 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:18,240 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:18,246 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:18,246 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:19,688 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:19,694 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:19,694 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:21,161 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4706.600000 2021-11-21 23:18:21,167 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:21,167 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:22,634 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5248.500000 2021-11-21 23:18:22,641 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:22,641 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:24,114 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5196.700000 2021-11-21 23:18:24,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:24,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:25,654 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5196.700000 2021-11-21 23:18:25,661 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:25,661 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:27,112 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5196.700000 2021-11-21 23:18:27,118 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:27,119 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:28,548 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5196.700000 2021-11-21 23:18:28,552 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:28,553 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:30,069 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5196.700000 2021-11-21 23:18:30,075 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:30,075 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:31,473 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5068.000000 2021-11-21 23:18:31,480 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:31,480 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:32,941 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 5068.000000 2021-11-21 23:18:32,947 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:32,948 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:34,385 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4873.400000 2021-11-21 23:18:34,394 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:34,394 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:35,878 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4873.400000 2021-11-21 23:18:35,885 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:35,885 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:37,338 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4873.400000 2021-11-21 23:18:37,345 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:37,345 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:38,812 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4873.400000 2021-11-21 23:18:38,819 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:38,819 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:40,260 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4873.400000 2021-11-21 23:18:40,267 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:40,269 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:41,740 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4639.300000 2021-11-21 23:18:41,746 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:41,746 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:43,142 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4639.300000 2021-11-21 23:18:43,148 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:43,148 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:44,608 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.300000 2021-11-21 23:18:44,614 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:44,615 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:46,085 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.300000 2021-11-21 23:18:46,092 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:46,092 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:47,502 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.300000 2021-11-21 23:18:47,507 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:47,507 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:49,061 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.300000 2021-11-21 23:18:49,068 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:49,069 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:50,515 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.300000 2021-11-21 23:18:50,520 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:50,522 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:51,979 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.100000 2021-11-21 23:18:51,986 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:51,986 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:53,427 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:18:53,431 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:53,433 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:54,923 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:18:54,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:54,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:56,437 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:18:56,443 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:56,443 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:57,872 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:18:57,878 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:57,878 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:18:59,318 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:18:59,323 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:18:59,325 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:00,880 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.600000 2021-11-21 23:19:00,887 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:00,888 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:02,368 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4642.700000 2021-11-21 23:19:02,372 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:02,374 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:03,878 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:03,884 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:03,884 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:05,384 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:05,391 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:05,391 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:06,819 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:06,825 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:06,826 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:08,237 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:08,243 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:08,243 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:09,694 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:09,701 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:09,703 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:11,160 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.300000 2021-11-21 23:19:11,164 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:11,165 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:12,651 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.100000 2021-11-21 23:19:12,658 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:12,658 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:14,144 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4609.600000 2021-11-21 23:19:14,151 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:14,151 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:15,634 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4609.600000 2021-11-21 23:19:15,641 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:15,641 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:17,075 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4609.600000 2021-11-21 23:19:17,081 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:17,082 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:18,482 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4609.600000 2021-11-21 23:19:18,486 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:18,487 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:19,992 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4609.600000 2021-11-21 23:19:19,997 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:19,999 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:21,486 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4720.700000 2021-11-21 23:19:21,492 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:21,493 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:22,977 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4720.700000 2021-11-21 23:19:22,984 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:22,986 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:24,457 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4776.100000 2021-11-21 23:19:24,463 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:24,463 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:25,924 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4776.100000 2021-11-21 23:19:25,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:25,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:27,358 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4776.100000 2021-11-21 23:19:27,365 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:27,365 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:28,779 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4776.100000 2021-11-21 23:19:28,785 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:28,785 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:30,232 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4776.100000 2021-11-21 23:19:30,237 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:30,239 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:31,726 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:19:31,733 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:31,734 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:33,230 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:19:33,236 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:33,236 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:34,720 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4335.000000 2021-11-21 23:19:34,724 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:34,726 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:36,196 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4335.000000 2021-11-21 23:19:36,200 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:36,200 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:37,681 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4335.000000 2021-11-21 23:19:37,688 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:37,690 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:39,148 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4335.000000 2021-11-21 23:19:39,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:39,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:40,582 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4335.000000 2021-11-21 23:19:40,588 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:40,588 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:42,147 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4435.800000 2021-11-21 23:19:42,151 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:42,153 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:43,588 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:43,595 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:43,595 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:45,046 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:45,053 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:45,055 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:46,670 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:46,677 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:46,677 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:48,118 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:48,124 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:48,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:49,584 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:49,592 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:49,594 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:51,150 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.700000 2021-11-21 23:19:51,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:51,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:52,663 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4615.300000 2021-11-21 23:19:52,671 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:52,671 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:54,125 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4608.000000 2021-11-21 23:19:54,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:54,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:55,572 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4608.000000 2021-11-21 23:19:55,578 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:55,578 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:57,119 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4608.000000 2021-11-21 23:19:57,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:57,127 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:58,584 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4608.000000 2021-11-21 23:19:58,589 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:19:58,591 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:19:59,701 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' completed 2021-11-21 23:19:59,703 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98' started 2021-11-21 23:20:00,058 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4608.000000 2021-11-21 23:20:00,063 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:00,065 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:00,125 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' completed 2021-11-21 23:20:00,127 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' started 2021-11-21 23:20:00,200 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98' completed 2021-11-21 23:20:00,200 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98' started 2021-11-21 23:20:00,229 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98' completed 2021-11-21 23:20:00,230 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98' started 2021-11-21 23:20:00,275 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98' completed 2021-11-21 23:20:00,276 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' started 2021-11-21 23:20:00,293 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98' completed 2021-11-21 23:20:00,295 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98' started 2021-11-21 23:20:00,296 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98' completed 2021-11-21 23:20:00,296 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98' started 2021-11-21 23:20:00,341 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98' completed 2021-11-21 23:20:00,342 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' started 2021-11-21 23:20:00,378 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' completed 2021-11-21 23:20:00,380 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98' started 2021-11-21 23:20:00,395 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98' completed 2021-11-21 23:20:00,397 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97' completed 2021-11-21 23:20:00,397 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98' started 2021-11-21 23:20:00,397 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' started 2021-11-21 23:20:00,398 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97 are 20000 2021-11-21 23:20:00,398 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 600000 to 620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97 2021-11-21 23:20:00,398 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:20:00,450 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' completed 2021-11-21 23:20:00,453 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98' started 2021-11-21 23:20:00,647 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98' completed 2021-11-21 23:20:00,648 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' started 2021-11-21 23:20:00,648 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98 are 20000 2021-11-21 23:20:00,650 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 600000 to 620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:20:00,651 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:00,676 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98' completed 2021-11-21 23:20:00,677 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98' started 2021-11-21 23:20:00,696 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' completed 2021-11-21 23:20:00,697 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98' started 2021-11-21 23:20:00,711 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' completed 2021-11-21 23:20:00,713 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' started 2021-11-21 23:20:00,780 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98' completed 2021-11-21 23:20:00,782 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98' started 2021-11-21 23:20:00,818 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98' completed 2021-11-21 23:20:00,819 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' started 2021-11-21 23:20:00,859 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98' completed 2021-11-21 23:20:00,861 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98' started 2021-11-21 23:20:00,924 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' completed 2021-11-21 23:20:00,927 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' started 2021-11-21 23:20:00,937 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98' completed 2021-11-21 23:20:00,938 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98' started 2021-11-21 23:20:00,953 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' completed 2021-11-21 23:20:00,953 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98' started 2021-11-21 23:20:01,210 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98' completed 2021-11-21 23:20:01,210 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' started 2021-11-21 23:20:01,413 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' completed 2021-11-21 23:20:01,415 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98' started 2021-11-21 23:20:01,542 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4592.800000 2021-11-21 23:20:01,549 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:01,549 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:01,601 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' completed 2021-11-21 23:20:01,602 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98' started 2021-11-21 23:20:01,624 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' completed 2021-11-21 23:20:01,625 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' started 2021-11-21 23:20:01,637 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' completed 2021-11-21 23:20:01,638 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98' started 2021-11-21 23:20:01,638 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 are 20000 2021-11-21 23:20:01,640 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 620000 to 640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:01,641 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:01,641 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98 are 20000 2021-11-21 23:20:01,641 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 620000 to 640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:01,641 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:20:01,642 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98 are 20000 2021-11-21 23:20:01,644 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 640000 to 660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:20:01,644 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:20:01,644 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 are 20000 2021-11-21 23:20:01,645 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 640000 to 660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:20:01,647 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:20:01,647 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98 are 20000 2021-11-21 23:20:01,648 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 660000 to 680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:20:01,648 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:20:01,648 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 are 20000 2021-11-21 23:20:01,650 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 660000 to 680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:20:01,651 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:20:01,651 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98 are 20000 2021-11-21 23:20:01,651 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 680000 to 700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:20:01,653 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:20:01,654 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 are 20000 2021-11-21 23:20:01,654 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 680000 to 700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:20:01,654 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:20:01,655 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98 are 20000 2021-11-21 23:20:01,657 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 700000 to 720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:20:01,657 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:20:01,657 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 are 20000 2021-11-21 23:20:01,657 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 700000 to 720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:20:01,658 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:20:01,658 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98 are 20000 2021-11-21 23:20:01,660 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 720000 to 740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:20:01,660 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:20:01,661 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 are 20000 2021-11-21 23:20:01,661 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 720000 to 740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:20:01,661 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:20:01,663 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98 are 20000 2021-11-21 23:20:01,663 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 740000 to 760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:20:01,664 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:20:01,664 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98 are 20000 2021-11-21 23:20:01,664 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 760000 to 780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:20:01,667 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:20:01,667 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 are 20000 2021-11-21 23:20:01,668 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 740000 to 760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:20:01,670 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:20:01,670 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98 are 20000 2021-11-21 23:20:01,671 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 780000 to 800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:20:01,671 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:20:01,671 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 are 20000 2021-11-21 23:20:01,673 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 760000 to 780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:20:01,674 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:20:01,674 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98 are 20000 2021-11-21 23:20:01,674 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 800000 to 820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:20:01,676 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:20:01,676 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 are 20000 2021-11-21 23:20:01,677 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 780000 to 800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:20:01,677 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:20:01,678 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98 are 20000 2021-11-21 23:20:01,680 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 820000 to 840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:20:01,680 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:20:01,680 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98 are 20000 2021-11-21 23:20:01,681 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 840000 to 860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:20:01,683 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:20:01,683 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 are 20000 2021-11-21 23:20:01,684 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 800000 to 820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:20:01,684 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:20:02,540 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98' completed 2021-11-21 23:20:02,542 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99' started 2021-11-21 23:20:02,542 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98 are 20000 2021-11-21 23:20:02,542 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 600000 to 620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:20:02,543 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:20:02,545 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98 are 20000 2021-11-21 23:20:02,545 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 860000 to 880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:20:02,546 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:20:02,546 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 are 20000 2021-11-21 23:20:02,546 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 820000 to 840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:20:02,548 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:02,548 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 are 20000 2021-11-21 23:20:02,549 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 620000 to 640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:20:02,549 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:20:03,065 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4592.800000 2021-11-21 23:20:03,071 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:03,072 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:04,628 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4566.000000 2021-11-21 23:20:04,635 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:04,637 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:06,125 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4566.000000 2021-11-21 23:20:06,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:06,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:07,617 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4566.000000 2021-11-21 23:20:07,625 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:07,625 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:09,081 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4566.000000 2021-11-21 23:20:09,085 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:09,085 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:10,525 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4566.000000 2021-11-21 23:20:10,532 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:10,532 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:12,026 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4503.700000 2021-11-21 23:20:12,033 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:12,033 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:13,447 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:13,453 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:13,453 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:14,990 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:15,000 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:15,000 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:16,470 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:16,480 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:16,482 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:17,961 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:17,970 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:17,971 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:19,453 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:19,457 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:19,459 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:20,947 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.600000 2021-11-21 23:20:20,953 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:20,954 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:22,395 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.700000 2021-11-21 23:20:22,403 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:22,404 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:23,895 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:23,901 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:23,901 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:25,407 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:25,414 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:25,414 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:26,914 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:26,920 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:26,921 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:28,341 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:28,346 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:28,348 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:29,809 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:29,818 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:29,819 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:31,348 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4692.900000 2021-11-21 23:20:31,354 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:31,355 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:32,839 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4906.000000 2021-11-21 23:20:32,846 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:32,846 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:34,315 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4970.900000 2021-11-21 23:20:34,322 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:34,322 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:35,865 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4970.900000 2021-11-21 23:20:35,871 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:35,872 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:37,315 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4970.900000 2021-11-21 23:20:37,319 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:37,319 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:38,796 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4970.900000 2021-11-21 23:20:38,802 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:38,802 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:40,273 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4970.900000 2021-11-21 23:20:40,279 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:40,280 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:41,778 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4896.300000 2021-11-21 23:20:41,783 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:41,786 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:43,299 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4896.300000 2021-11-21 23:20:43,305 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:43,305 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:44,765 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4943.600000 2021-11-21 23:20:44,770 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:44,770 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:46,266 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4943.600000 2021-11-21 23:20:46,273 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:46,275 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:47,822 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4943.600000 2021-11-21 23:20:47,826 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:47,828 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:49,359 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4943.600000 2021-11-21 23:20:49,368 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:49,368 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:50,851 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4943.600000 2021-11-21 23:20:50,859 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:50,862 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:52,321 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4848.600000 2021-11-21 23:20:52,326 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:52,328 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:53,848 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:20:53,858 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:53,859 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:55,309 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:20:55,313 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:55,315 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:56,783 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:20:56,789 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:56,790 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:58,234 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:20:58,240 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:58,240 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:20:59,703 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:20:59,709 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:20:59,710 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:01,203 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.300000 2021-11-21 23:21:01,210 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:01,210 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:02,661 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.500000 2021-11-21 23:21:02,665 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:02,667 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:04,275 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:21:04,280 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:04,282 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:05,776 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:21:05,782 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:05,783 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:07,220 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:21:07,227 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:07,229 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:08,688 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:21:08,694 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:08,696 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:10,214 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:21:10,220 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:10,220 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:11,753 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4789.900000 2021-11-21 23:21:11,759 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:11,760 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:13,213 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4789.900000 2021-11-21 23:21:13,221 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:13,223 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:14,724 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4748.600000 2021-11-21 23:21:14,732 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:14,733 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:16,270 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4748.600000 2021-11-21 23:21:16,316 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:16,318 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:17,832 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4748.600000 2021-11-21 23:21:17,836 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:17,838 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:19,273 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4748.600000 2021-11-21 23:21:19,278 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:19,279 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:20,743 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4748.600000 2021-11-21 23:21:20,750 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:20,750 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:22,206 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4756.300000 2021-11-21 23:21:22,211 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:22,213 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:23,822 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:23,832 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:23,832 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:25,286 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:25,292 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:25,292 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:26,798 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:26,803 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:26,805 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:28,296 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:28,302 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:28,302 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:29,829 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:29,835 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:29,835 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:31,309 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.900000 2021-11-21 23:21:31,315 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:31,315 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:32,795 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4686.400000 2021-11-21 23:21:32,802 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:32,803 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:34,223 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4768.600000 2021-11-21 23:21:34,229 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:34,229 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:35,690 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4768.600000 2021-11-21 23:21:35,694 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:35,696 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:37,188 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4768.600000 2021-11-21 23:21:37,194 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:37,194 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:38,650 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4768.600000 2021-11-21 23:21:38,655 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:38,657 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:40,092 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4768.600000 2021-11-21 23:21:40,096 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:40,098 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:41,568 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.100000 2021-11-21 23:21:41,572 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:41,573 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:43,036 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.100000 2021-11-21 23:21:43,042 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:43,042 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:44,561 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4594.600000 2021-11-21 23:21:44,568 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:44,569 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:46,043 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4594.600000 2021-11-21 23:21:46,049 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:46,049 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:47,530 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4594.600000 2021-11-21 23:21:47,538 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:47,539 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:49,007 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4594.600000 2021-11-21 23:21:49,013 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:49,015 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:50,486 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4594.600000 2021-11-21 23:21:50,492 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:50,493 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:52,046 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.000000 2021-11-21 23:21:52,052 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:52,052 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:53,601 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:21:53,608 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:53,608 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:55,125 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:21:55,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:55,131 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:56,642 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:21:56,648 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:56,648 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:58,082 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:21:58,088 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:58,088 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:58,655 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' completed 2021-11-21 23:21:58,657 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99' started 2021-11-21 23:21:58,950 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98' completed 2021-11-21 23:21:58,950 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99' started 2021-11-21 23:21:58,951 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98 are 20000 2021-11-21 23:21:58,951 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' completed 2021-11-21 23:21:58,953 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 880000 to 900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:21:58,953 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99' started 2021-11-21 23:21:58,953 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:21:59,052 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' completed 2021-11-21 23:21:59,052 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99' started 2021-11-21 23:21:59,053 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 are 20000 2021-11-21 23:21:59,055 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 640000 to 660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:21:59,055 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:21:59,414 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98' completed 2021-11-21 23:21:59,415 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99' started 2021-11-21 23:21:59,417 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98 are 20000 2021-11-21 23:21:59,417 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 840000 to 860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98 2021-11-21 23:21:59,417 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:21:59,447 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98' completed 2021-11-21 23:21:59,447 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99' started 2021-11-21 23:21:59,453 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' completed 2021-11-21 23:21:59,454 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99' started 2021-11-21 23:21:59,542 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:21:59,546 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' completed 2021-11-21 23:21:59,546 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:21:59,546 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99' started 2021-11-21 23:21:59,548 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:21:59,703 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' completed 2021-11-21 23:21:59,704 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99' started 2021-11-21 23:21:59,743 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' completed 2021-11-21 23:21:59,744 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99' started 2021-11-21 23:21:59,885 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98' completed 2021-11-21 23:21:59,887 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99' started 2021-11-21 23:22:00,065 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98' completed 2021-11-21 23:22:00,066 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99' started 2021-11-21 23:22:00,138 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' completed 2021-11-21 23:22:00,141 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99' started 2021-11-21 23:22:00,289 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98' completed 2021-11-21 23:22:00,289 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99' started 2021-11-21 23:22:00,367 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98' completed 2021-11-21 23:22:00,368 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99' started 2021-11-21 23:22:00,392 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98' completed 2021-11-21 23:22:00,394 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99' started 2021-11-21 23:22:00,428 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98' completed 2021-11-21 23:22:00,430 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99' started 2021-11-21 23:22:00,430 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98 are 20000 2021-11-21 23:22:00,430 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' completed 2021-11-21 23:22:00,430 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 900000 to 920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:22:00,431 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99' started 2021-11-21 23:22:00,431 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:22:00,433 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 are 20000 2021-11-21 23:22:00,434 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 660000 to 680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98 2021-11-21 23:22:00,434 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:22:00,434 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' completed 2021-11-21 23:22:00,434 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98 are 20000 2021-11-21 23:22:00,437 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 860000 to 880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98 2021-11-21 23:22:00,437 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:22:00,436 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99' started 2021-11-21 23:22:00,779 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98' completed 2021-11-21 23:22:00,780 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99' started 2021-11-21 23:22:00,780 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98 are 20000 2021-11-21 23:22:00,782 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 920000 to 940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:22:00,782 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:22:00,783 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 are 20000 2021-11-21 23:22:00,785 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 680000 to 700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98 2021-11-21 23:22:00,786 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:22:00,786 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98 are 20000 2021-11-21 23:22:00,788 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 880000 to 900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98 2021-11-21 23:22:00,789 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:22:00,789 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98 are 20000 2021-11-21 23:22:00,789 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 940000 to 960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:22:00,790 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:22:00,790 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 are 20000 2021-11-21 23:22:00,792 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 700000 to 720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98 2021-11-21 23:22:00,792 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:22:00,792 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98 are 20000 2021-11-21 23:22:00,792 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 900000 to 920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98 2021-11-21 23:22:00,793 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:22:00,795 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 are 20000 2021-11-21 23:22:00,795 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 720000 to 740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98 2021-11-21 23:22:00,796 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:22:01,025 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4384.900000 2021-11-21 23:22:01,032 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:01,032 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:01,108 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98' completed 2021-11-21 23:22:01,109 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99' started 2021-11-21 23:22:01,378 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98' completed 2021-11-21 23:22:01,380 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99' started 2021-11-21 23:22:01,549 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98' completed 2021-11-21 23:22:01,551 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99' started 2021-11-21 23:22:01,578 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98' completed 2021-11-21 23:22:01,578 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99' started 2021-11-21 23:22:01,602 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98' completed 2021-11-21 23:22:01,615 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98' completed 2021-11-21 23:22:01,617 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98 are 20000 2021-11-21 23:22:01,617 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 960000 to 980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:22:01,618 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:22:01,618 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98 are 20000 2021-11-21 23:22:01,618 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 920000 to 940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98 2021-11-21 23:22:01,619 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:22:01,619 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 are 20000 2021-11-21 23:22:01,621 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 740000 to 760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98 2021-11-21 23:22:01,621 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:22:01,621 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98 are 20000 2021-11-21 23:22:01,622 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 980000 to 1000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:22:01,622 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:22:01,624 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 are 20000 2021-11-21 23:22:01,625 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 760000 to 780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98 2021-11-21 23:22:01,625 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:22:01,625 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98 are 20000 2021-11-21 23:22:01,627 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 940000 to 960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98 2021-11-21 23:22:01,628 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:22:01,628 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 are 20000 2021-11-21 23:22:01,628 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 780000 to 800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98 2021-11-21 23:22:01,630 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:22:01,884 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98' completed 2021-11-21 23:22:01,885 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98 are 20000 2021-11-21 23:22:01,887 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 600000 to 620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98 2021-11-21 23:22:01,888 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:22:01,888 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98 are 20000 2021-11-21 23:22:01,888 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 960000 to 980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98 2021-11-21 23:22:01,888 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:22:01,890 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 are 20000 2021-11-21 23:22:01,891 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 800000 to 820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98 2021-11-21 23:22:01,891 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:22:01,891 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98 are 20000 2021-11-21 23:22:01,892 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 620000 to 640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98 2021-11-21 23:22:01,892 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:22:01,894 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98 are 20000 2021-11-21 23:22:01,894 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 980000 to 1000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98 2021-11-21 23:22:01,897 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:22:01,898 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 are 20000 2021-11-21 23:22:01,898 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 820000 to 840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98 2021-11-21 23:22:01,898 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:22:01,900 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98 are 20000 2021-11-21 23:22:01,901 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 640000 to 660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98 2021-11-21 23:22:01,901 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99 2021-11-21 23:22:02,473 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99' completed 2021-11-21 23:22:02,473 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99 are 20000 2021-11-21 23:22:02,474 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 660000 to 680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99 2021-11-21 23:22:02,476 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:22:02,532 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4433.500000 2021-11-21 23:22:02,539 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:02,539 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:04,069 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.700000 2021-11-21 23:22:04,073 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:04,075 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:05,599 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.700000 2021-11-21 23:22:05,605 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:05,607 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:07,085 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.700000 2021-11-21 23:22:07,092 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:07,094 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:08,575 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.700000 2021-11-21 23:22:08,581 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:08,582 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:10,002 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.700000 2021-11-21 23:22:10,007 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:10,009 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:11,566 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4571.400000 2021-11-21 23:22:11,573 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:11,575 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:13,111 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4571.400000 2021-11-21 23:22:13,117 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:13,118 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:14,608 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4553.800000 2021-11-21 23:22:14,615 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:14,617 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:16,148 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4553.800000 2021-11-21 23:22:16,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:16,157 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:17,598 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4553.800000 2021-11-21 23:22:17,604 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:17,605 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:19,072 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4553.800000 2021-11-21 23:22:19,078 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:19,079 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:20,625 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4553.800000 2021-11-21 23:22:20,631 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:20,632 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:22,174 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.300000 2021-11-21 23:22:22,183 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:22,184 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:23,726 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:23,732 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:23,733 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:25,282 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:25,289 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:25,289 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:26,793 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:26,802 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:26,802 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:28,346 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:28,354 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:28,355 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:29,901 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:29,907 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:29,907 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:31,395 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.800000 2021-11-21 23:22:31,403 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:31,404 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:32,818 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.900000 2021-11-21 23:22:32,825 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:32,826 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:34,305 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:22:34,312 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:34,312 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:35,740 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:22:35,746 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:35,746 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:37,240 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:22:37,246 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:37,247 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:38,825 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:22:38,832 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:38,834 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:40,401 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-21 23:22:40,407 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:40,408 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:41,865 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4533.200000 2021-11-21 23:22:41,871 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:41,871 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:43,378 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4533.200000 2021-11-21 23:22:43,382 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:43,384 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:44,868 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4464.900000 2021-11-21 23:22:44,875 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:44,877 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:46,319 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4464.900000 2021-11-21 23:22:46,325 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:46,325 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:47,769 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4464.900000 2021-11-21 23:22:47,773 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:47,775 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:49,196 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4464.900000 2021-11-21 23:22:49,203 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:49,203 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:50,661 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4464.900000 2021-11-21 23:22:50,667 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:50,667 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:52,118 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4363.100000 2021-11-21 23:22:52,124 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:52,124 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:53,569 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:22:53,576 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:53,578 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:55,013 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:22:55,019 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:55,019 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:56,467 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:22:56,473 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:56,473 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:58,019 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:22:58,026 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:58,026 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:22:59,486 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:22:59,493 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:22:59,493 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:00,937 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4201.600000 2021-11-21 23:23:00,943 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:00,944 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:02,382 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4176.100000 2021-11-21 23:23:02,388 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:02,388 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:03,894 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:03,901 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:03,901 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:05,375 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:05,378 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:05,380 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:06,930 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:06,934 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:06,934 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:08,387 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:08,391 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:08,391 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:09,845 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:09,851 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:09,851 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:11,332 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4193.300000 2021-11-21 23:23:11,336 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:11,336 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:12,750 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3967.700000 2021-11-21 23:23:12,756 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:12,756 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:14,242 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3662.900000 2021-11-21 23:23:14,247 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:14,247 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:15,651 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3662.900000 2021-11-21 23:23:15,657 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:15,658 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:17,119 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3662.900000 2021-11-21 23:23:17,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:17,125 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:18,594 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3662.900000 2021-11-21 23:23:18,598 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:18,599 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:20,066 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3662.900000 2021-11-21 23:23:20,072 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:20,072 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:21,586 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3789.100000 2021-11-21 23:23:21,595 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:21,595 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:23,121 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3789.100000 2021-11-21 23:23:23,128 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:23,130 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:24,644 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4000.900000 2021-11-21 23:23:24,651 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:24,651 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:26,135 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4000.900000 2021-11-21 23:23:26,142 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:26,144 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:27,605 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4000.900000 2021-11-21 23:23:27,612 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:27,614 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:29,098 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4000.900000 2021-11-21 23:23:29,102 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:29,104 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:30,530 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 4000.900000 2021-11-21 23:23:30,535 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:30,536 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:32,000 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3591.400000 2021-11-21 23:23:32,005 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:32,006 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:33,483 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:33,489 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:33,490 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:34,950 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:34,956 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:34,957 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:36,450 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:36,456 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:36,456 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:37,927 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:37,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:37,931 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:39,387 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:39,392 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:39,394 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:40,832 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3073.700000 2021-11-21 23:23:40,838 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:40,839 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:42,345 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3171.300000 2021-11-21 23:23:42,349 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:42,349 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:43,766 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:43,772 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:43,772 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:45,313 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:45,319 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:45,319 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:46,769 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:46,776 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:46,776 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:48,236 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:48,243 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:48,243 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:49,719 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:49,723 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:49,724 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:51,263 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3398.200000 2021-11-21 23:23:51,267 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:51,269 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:52,911 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3464.100000 2021-11-21 23:23:52,915 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:52,917 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:54,411 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3597.000000 2021-11-21 23:23:54,415 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:54,417 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:55,924 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3597.000000 2021-11-21 23:23:55,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:55,931 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:57,405 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3597.000000 2021-11-21 23:23:57,413 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:57,414 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:57,743 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99' completed 2021-11-21 23:23:58,190 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99' completed 2021-11-21 23:23:58,782 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99' completed 2021-11-21 23:23:58,884 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99' completed 2021-11-21 23:23:58,885 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99 are 20000 2021-11-21 23:23:58,887 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 840000 to 860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:23:58,887 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99 2021-11-21 23:23:58,888 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99 are 20000 2021-11-21 23:23:58,888 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 680000 to 700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99 2021-11-21 23:23:58,888 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:23:58,891 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3597.000000 2021-11-21 23:23:58,897 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:23:58,898 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:23:58,911 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99' completed 2021-11-21 23:23:58,996 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99' completed 2021-11-21 23:23:59,065 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99' completed 2021-11-21 23:23:59,101 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99' completed 2021-11-21 23:23:59,138 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99' completed 2021-11-21 23:23:59,141 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99' completed 2021-11-21 23:23:59,174 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99' completed 2021-11-21 23:23:59,193 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99' completed 2021-11-21 23:23:59,194 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99 are 20000 2021-11-21 23:23:59,194 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 860000 to 880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:23:59,194 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:23:59,216 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99' completed 2021-11-21 23:23:59,233 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99' completed 2021-11-21 23:23:59,296 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99' completed 2021-11-21 23:23:59,355 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99' completed 2021-11-21 23:23:59,378 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99' completed 2021-11-21 23:23:59,380 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99 are 20000 2021-11-21 23:23:59,380 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 880000 to 900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:23:59,381 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99 2021-11-21 23:23:59,381 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99 are 20000 2021-11-21 23:23:59,381 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 700000 to 720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99 2021-11-21 23:23:59,382 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:23:59,382 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99 are 20000 2021-11-21 23:23:59,384 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 900000 to 920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:23:59,384 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99 2021-11-21 23:23:59,384 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99 are 20000 2021-11-21 23:23:59,385 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 720000 to 740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99 2021-11-21 23:23:59,385 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:23:59,387 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99 are 20000 2021-11-21 23:23:59,388 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 920000 to 940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:23:59,388 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99 2021-11-21 23:23:59,388 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99 are 20000 2021-11-21 23:23:59,388 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 740000 to 760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99 2021-11-21 23:23:59,390 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:23:59,390 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99 are 20000 2021-11-21 23:23:59,391 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 940000 to 960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:23:59,391 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99 2021-11-21 23:23:59,391 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99 are 20000 2021-11-21 23:23:59,391 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 760000 to 780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99 2021-11-21 23:23:59,392 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:23:59,392 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99 are 20000 2021-11-21 23:23:59,394 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 960000 to 980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:23:59,394 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:23:59,394 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99 are 20000 2021-11-21 23:23:59,395 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 980000 to 1000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:23:59,395 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99 2021-11-21 23:23:59,401 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99' completed 2021-11-21 23:23:59,403 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99 are 20000 2021-11-21 23:23:59,404 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 780000 to 800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99 2021-11-21 23:23:59,404 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99 2021-11-21 23:23:59,404 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99 are 20000 2021-11-21 23:23:59,404 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 800000 to 820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99 2021-11-21 23:23:59,405 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99 2021-11-21 23:23:59,611 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99' completed 2021-11-21 23:23:59,612 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99 are 20000 2021-11-21 23:23:59,614 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 820000 to 840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99 2021-11-21 23:23:59,614 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:23:59,615 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99 are 20000 2021-11-21 23:23:59,615 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 840000 to 860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99 2021-11-21 23:23:59,617 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:23:59,617 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99 are 20000 2021-11-21 23:23:59,618 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 860000 to 880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99 2021-11-21 23:23:59,618 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:23:59,618 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99 are 20000 2021-11-21 23:23:59,619 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 880000 to 900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99 2021-11-21 23:23:59,621 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:23:59,737 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99' completed 2021-11-21 23:23:59,750 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99' completed 2021-11-21 23:23:59,917 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99' completed 2021-11-21 23:23:59,967 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99' completed 2021-11-21 23:23:59,967 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99 are 20000 2021-11-21 23:23:59,969 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 900000 to 920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99 2021-11-21 23:23:59,969 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:23:59,970 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99 are 20000 2021-11-21 23:23:59,970 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 920000 to 940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99 2021-11-21 23:23:59,970 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:23:59,971 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99 are 20000 2021-11-21 23:23:59,973 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 940000 to 960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99 2021-11-21 23:23:59,973 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:24:00,227 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99' completed 2021-11-21 23:24:00,229 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99 are 20000 2021-11-21 23:24:00,230 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 960000 to 980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99 2021-11-21 23:24:00,230 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:24:00,230 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99 are 20000 2021-11-21 23:24:00,232 | test | DEBUG | pool-3-thread-13 | [task:execute_tasks:3915] Failed to load 0 docs from 980000 to 1000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99 2021-11-21 23:24:00,232 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637565482.99 2021-11-21 23:24:00,332 | test | DEBUG | pool-3-thread-22 | [task:record_bucket_ops:3570] Ops rate for 'default': 3597.000000 2021-11-21 23:24:00,335 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:24:00,335 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:24:01,345 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'default' +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | ******.......................................*..................................................******...........X | 5248.500 | | 5196.700 | ..................................................................................................****X | 5196.700 | | 5068.000 | ...............................................................................................*X | 5068.000 | | 4873.400 | ...........................................................................................****X | 4873.400 | | 4639.300 | .......................................................................................**.*****....X | 4902.100 | | 4805.600 | ..........................................................................................*****X | 4805.600 | | 4642.700 | .......................................................................................X | 4642.700 | | 4573.300 | ......................................................................................*****X | 4573.300 | | 4550.100 | .....................................................................................*.*****..**.****X | 4776.100 | | 4599.000 | ......................................................................................*X | 4599.000 | | 4335.000 | .................................................................................*****..*....*****X | 4630.700 | | 4615.300 | ......................................................................................X | 4615.300 | | 4608.000 | ......................................................................................****X | 4608.000 | | 4592.800 | ......................................................................................*X | 4592.800 | | 4566.000 | .....................................................................................****X | 4566.000 | | 4503.700 | ....................................................................................X | 4503.700 | | 4396.600 | ..................................................................................******..*....******....*.****X | 4970.900 | | 4896.300 | ............................................................................................**.****X | 4943.600 | | 4848.600 | ...........................................................................................X | 4848.600 | | 4673.300 | ........................................................................................*******..****X | 4790.700 | | 4789.900 | ..........................................................................................*X | 4789.900 | | 4748.600 | .........................................................................................*****X | 4756.300 | | 4717.900 | ........................................................................................*****X | 4717.900 | | 4686.400 | ........................................................................................*.****X | 4768.600 | | 4708.100 | ........................................................................................*X | 4708.100 | | 4594.600 | ......................................................................................****X | 4594.600 | | 4487.000 | ....................................................................................X | 4487.000 | | 4384.900 | ..................................................................................******.*..*****.*X | 4571.400 | | 4553.800 | .....................................................................................*****..******X | 4625.800 | | 4570.900 | ......................................................................................*****X | 4599.000 | | 4533.200 | .....................................................................................*X | 4533.200 | | 4464.900 | ....................................................................................****X | 4464.900 | | 4363.100 | ..................................................................................X | 4363.100 | | 4201.600 | ...............................................................................*****X | 4201.600 | | 4176.100 | ..............................................................................******X | 4193.300 | | 3967.700 | ..........................................................................X | 3967.700 | | 3662.900 | ....................................................................*****...**....****X | 4000.900 | | 3591.400 | ...................................................................X | 3591.400 | | 3073.700 | .........................................................******..*....******..*..****X | 3597.000 | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:24:01,346 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637565482.99' completed 2021-11-21 23:24:01,348 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:24:01,348 | infra | WARNING | pool-3-thread-13 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637565482.89' not completed 2021-11-21 23:24:01,348 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:24:01,348 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.97' complete. Loaded 20000 items 2021-11-21 23:24:01,349 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_600000_620000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,349 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,351 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_620000_640000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,351 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_640000_660000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,351 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,351 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_660000_680000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,352 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,352 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_680000_700000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,354 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,354 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_700000_720000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,355 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,355 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_720000_740000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,355 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,357 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_740000_760000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,358 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_760000_780000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,358 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,358 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_780000_800000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,358 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,359 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_800000_820000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,359 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,361 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_820000_840000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,361 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_840000_860000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,361 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,361 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_600000_620000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,362 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_860000_880000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,362 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,364 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_620000_640000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,364 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_880000_900000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,365 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_640000_660000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,365 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,365 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_900000_920000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,365 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_660000_680000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,367 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,367 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_920000_940000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,368 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_680000_700000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,368 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,368 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_940000_960000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,368 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_700000_720000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,369 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,369 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_720000_740000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,369 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_960000_980000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,371 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,371 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_740000_760000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,371 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default__default_ttl=0_create_NONE_980000_1000000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,372 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_760000_780000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,372 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,374 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_780000_800000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,375 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_600000_620000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,375 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,375 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_800000_820000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,375 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_620000_640000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,377 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default__default_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,377 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_820000_840000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,378 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_640000_660000_1637565482.98' complete. Loaded 20000 items 2021-11-21 23:24:01,378 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_660000_680000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,378 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_840000_860000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,378 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_680000_700000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,380 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_860000_880000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,381 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_880000_900000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,381 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_700000_720000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,381 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_900000_920000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,381 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_720000_740000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,382 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_920000_940000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,382 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_740000_760000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,384 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_940000_960000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,384 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_760000_780000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,384 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_960000_980000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,385 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection1_ttl=0_create_NONE_980000_1000000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,385 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_780000_800000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,387 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_800000_820000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,387 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_820000_840000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,388 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_840000_860000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,388 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_860000_880000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,388 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_880000_900000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,388 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_900000_920000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,390 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_920000_940000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,390 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_940000_960000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,391 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_960000_980000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,391 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637565482.89_default_Scope1_FunctionCollection0_ttl=0_create_NONE_980000_1000000_1637565482.99' complete. Loaded 20000 items 2021-11-21 23:24:01,428 | infra | INFO | pool-3-thread-13 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637565841.39 2021-11-21 23:24:01,430 | infra | DEBUG | pool-3-thread-13 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637565841.39 2021-11-21 23:24:01,428 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'PrintBucketStats_default_1637565841.39' started 2021-11-21 23:24:01,431 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637565841.39' completed 2021-11-21 23:24:01,431 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:24:01,433 | infra | WARNING | pool-3-thread-13 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637565482.89' not completed 2021-11-21 23:24:01,433 | infra | DEBUG | pool-3-thread-13 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:24:01,434 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637565482.89' completed 2021-11-21 23:24:01,622 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:24:01,642 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:24:01,901 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:24:02,135 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:24:02,273 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:24:02,276 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:24:02,308 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:24:02,338 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:24:02,368 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:24:02,410 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:24:02,436 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:24:02,466 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:24:02,496 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:24:02,496 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637565842.5 2021-11-21 23:24:02,496 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565842.5' started 2021-11-21 23:24:02,500 | infra | DEBUG | pool-3-thread-27 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:24:02,513 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:24:02,717 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:24:03,013 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:24:03,154 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:24:03,155 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:24:03,190 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:24:03,229 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:24:03,252 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:24:03,289 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:24:03,318 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:24:03,348 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:24:03,380 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:24:03,381 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637565843.38 2021-11-21 23:24:03,381 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637565842.5 2021-11-21 23:24:03,381 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565843.38' started 2021-11-21 23:24:03,384 | infra | DEBUG | pool-3-thread-3 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:24:05,147 | test | DEBUG | pool-3-thread-27 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:24:05,148 | test | DEBUG | pool-3-thread-27 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:24:05,148 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565842.5' completed 2021-11-21 23:24:05,151 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:24:05,151 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637565843.38 2021-11-21 23:24:05,897 | test | DEBUG | pool-3-thread-3 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:24:05,898 | test | DEBUG | pool-3-thread-3 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:24:05,898 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637565843.38' completed 2021-11-21 23:24:05,900 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:24:05,901 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:642] Added items from 600000 to 1000000 2021-11-21 23:24:05,903 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:05,903 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:05,976 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:05,977 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:05,977 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:05,977 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:05,979 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:05,979 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:05,980 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:05,980 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:06,051 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:06,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:06,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:06,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:06,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:06,053 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:06,053 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:06,055 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:06,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:06,073 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:24:16,075 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:16,075 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:16,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:16,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:16,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:16,155 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:16,155 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:16,157 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:16,157 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:16,157 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:16,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:16,232 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:16,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:16,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:16,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:16,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:16,233 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:16,234 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:16,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:16,252 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:24:26,253 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:26,253 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:26,318 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:26,319 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:26,319 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:26,319 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:26,321 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:26,321 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:26,322 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:26,322 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:26,384 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:26,385 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:26,387 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:26,387 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:26,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:26,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:26,388 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:26,388 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:26,405 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:26,407 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:24:36,407 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:36,408 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:36,503 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:36,503 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:36,503 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:36,505 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:36,506 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:36,506 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:36,506 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:36,507 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:36,576 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:36,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:36,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:36,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:36,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:36,579 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:36,579 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:36,581 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:36,598 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:36,598 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:24:46,598 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:46,599 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:46,667 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:46,667 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:46,667 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:46,667 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:46,668 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:46,668 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:46,670 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:46,671 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:46,752 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:46,753 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:46,753 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:46,753 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:46,755 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:46,756 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:46,756 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:46,756 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:46,775 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:46,775 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:24:56,776 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:24:56,776 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:24:56,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:24:56,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:56,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:56,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:24:56,846 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:56,846 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:56,848 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:24:56,848 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:24:56,918 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:24:56,920 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:24:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:24:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:24:56,921 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:24:56,923 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:24:56,940 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:24:56,941 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:06,943 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:06,944 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:07,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:07,015 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:07,016 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:07,016 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:07,086 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:07,086 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:07,088 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:07,088 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:07,088 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:07,088 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:07,089 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:07,089 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:07,107 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:07,108 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:17,108 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:17,108 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:17,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:17,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:17,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:17,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:17,181 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:17,181 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:17,183 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:17,184 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:17,247 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:17,249 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:17,249 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:17,250 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:17,250 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:17,250 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:17,250 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:17,250 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:17,266 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:17,267 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:27,269 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:27,269 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:27,338 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:27,339 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:27,341 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:27,341 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:27,342 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:27,342 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:27,342 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:27,342 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:27,408 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:27,408 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:27,410 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:27,410 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:27,411 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:27,411 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:27,411 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:27,411 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:27,428 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:27,428 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:37,430 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:37,430 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:37,499 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:37,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:37,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:37,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:37,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:37,502 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:37,502 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:37,503 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:37,601 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:37,601 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:37,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:37,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:37,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:37,604 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:37,605 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:37,605 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:37,621 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:37,621 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:47,622 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:47,624 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:47,690 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:47,691 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:47,691 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:47,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:47,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:47,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:47,694 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:47,694 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:47,765 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:47,766 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:47,766 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:47,766 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:47,766 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:47,767 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:47,767 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:47,769 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:47,786 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:47,786 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:25:57,786 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:25:57,788 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:25:57,862 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:25:57,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:57,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:57,865 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:25:57,865 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:57,865 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:57,865 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:25:57,867 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:25:57,984 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:25:57,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:57,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:57,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:25:57,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:25:57,987 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:25:57,987 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:25:57,989 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:25:58,006 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:25:58,006 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:08,007 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:08,007 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:08,072 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:08,072 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:08,073 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:08,073 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:08,075 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:08,075 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:08,075 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:08,075 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:08,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:08,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:08,145 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:08,145 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:08,147 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:08,147 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:08,148 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:08,148 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:08,164 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:08,164 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:18,165 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:18,167 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:18,227 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:18,229 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:18,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:18,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:18,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:18,230 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:18,230 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:18,232 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:18,302 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:18,302 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:18,303 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:18,303 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:18,305 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:18,305 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:18,305 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:18,306 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:18,325 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:18,325 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:28,325 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:28,326 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:28,394 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:28,395 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:28,397 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:28,397 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:28,397 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:28,398 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:28,398 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:28,398 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:28,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:28,463 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:28,463 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:28,463 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:28,463 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:28,464 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:28,464 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:28,466 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:28,483 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:28,483 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:38,483 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:38,484 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:38,559 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:38,559 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:38,559 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:38,559 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:38,561 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:38,561 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:38,562 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:38,562 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:38,635 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:38,637 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:38,637 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:38,638 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:38,638 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:38,638 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:38,638 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:38,640 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:38,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:38,657 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:48,658 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:48,660 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:48,727 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:48,729 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:48,730 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:48,730 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:48,730 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:48,730 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:48,732 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:48,732 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:48,846 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:48,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:48,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:48,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:48,848 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:48,849 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:48,849 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:48,851 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:48,871 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:48,871 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:26:58,872 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:26:58,877 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:26:58,951 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:26:58,951 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:58,953 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:58,953 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:26:58,953 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:58,953 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:58,953 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:26:58,954 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:26:59,020 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:26:59,022 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:59,022 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:59,023 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:26:59,023 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:26:59,023 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:26:59,023 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:26:59,025 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:26:59,040 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:26:59,042 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:09,042 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:09,042 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:09,119 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:09,121 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:09,121 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:09,121 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:09,121 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:09,122 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:09,124 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:09,124 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:27:09,193 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:27:09,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:09,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:09,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:27:09,194 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:09,196 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:09,196 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:27:09,196 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:27:09,213 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:27:09,214 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:19,216 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:19,217 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:19,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:19,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:19,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:19,289 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:19,290 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:19,290 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:19,292 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:19,292 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:27:19,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:27:19,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:19,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:19,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:27:19,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:19,365 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:19,365 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:27:19,365 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:27:19,382 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:27:19,384 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:29,384 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:29,385 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:29,459 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:29,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:29,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:29,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:29,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:29,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:29,463 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:29,463 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:27:29,529 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:27:29,529 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:29,530 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:29,530 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:27:29,532 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:29,532 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:29,532 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:27:29,532 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:27:29,549 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:27:29,549 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:39,551 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:39,551 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:39,615 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:39,615 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:39,615 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:39,617 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:39,617 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:39,618 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:39,618 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:39,618 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:27:39,684 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:27:39,684 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:39,684 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:39,686 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:27:39,686 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:39,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:39,687 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:27:39,687 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:27:39,704 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:27:39,706 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:49,707 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:49,707 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:49,782 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:49,783 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:49,783 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:49,785 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:49,785 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:49,785 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:49,786 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:49,786 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:27:49,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:27:49,861 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:49,862 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:49,862 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:27:49,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:49,864 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:49,865 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:27:49,865 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:27:49,885 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:27:49,885 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:27:59,887 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:27:59,888 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:27:59,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:27:59,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:59,963 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:59,964 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:27:59,966 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:27:59,966 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:27:59,967 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:27:59,967 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:00,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:00,032 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:00,033 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:00,033 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:00,035 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:00,035 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:00,036 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:00,036 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:00,055 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:00,055 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:28:10,056 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:28:10,056 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:28:10,124 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:28:10,124 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:10,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:10,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:28:10,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:10,125 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:10,127 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:28:10,127 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:10,190 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:10,190 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:10,191 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:10,191 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:10,193 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:10,193 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:10,194 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:10,194 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:10,210 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:10,211 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:28:20,213 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:28:20,213 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:28:20,283 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:28:20,285 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:20,285 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:20,285 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:28:20,286 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:20,286 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:20,286 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:28:20,286 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:20,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:20,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:20,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:20,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:20,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:20,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:20,364 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:20,365 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:20,381 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:20,381 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:28:30,382 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:28:30,384 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:28:30,453 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:28:30,453 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:30,453 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:30,454 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:28:30,454 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:30,456 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:30,456 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:28:30,457 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:30,532 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:30,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:30,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:30,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:30,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:30,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:30,536 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:30,536 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:30,552 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:30,553 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:28:40,555 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:28:40,555 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:28:40,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:28:40,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:40,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:40,627 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:28:40,627 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:40,628 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:40,628 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:28:40,628 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:40,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:40,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:40,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:40,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:40,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:40,696 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:40,696 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:40,697 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:40,714 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:40,716 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:28:50,717 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:28:50,717 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:28:50,782 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:28:50,782 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:50,783 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:50,783 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:28:50,785 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:50,785 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:50,786 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:28:50,786 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:28:50,852 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:28:50,852 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:50,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:50,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:28:50,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:28:50,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:28:50,855 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:28:50,855 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:28:50,875 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:28:50,875 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:29:00,877 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:29:00,878 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:29:00,941 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:29:00,943 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:29:00,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:29:00,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:29:00,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:29:00,946 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:29:00,946 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:29:00,947 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:29:01,009 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:29:01,010 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:29:01,010 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:29:01,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:29:01,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:29:01,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:29:01,013 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:29:01,013 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:29:01,030 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:29:01,030 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:29:11,052 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:29:11,052 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637566151.05 2021-11-21 23:29:11,052 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637566151.05' started 2021-11-21 23:29:11,053 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637566151.05 2021-11-21 23:29:11,227 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637566151.19 2021-11-21 23:29:11,227 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'PrintBucketStats_default_1637566151.19' started 2021-11-21 23:29:11,229 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:29:11,229 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:29:11,229 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' started 2021-11-21 23:29:11,229 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16' started 2021-11-21 23:29:11,230 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' started 2021-11-21 23:29:11,230 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:29:11,232 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:29:11,232 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17' started 2021-11-21 23:29:11,233 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:29:11,233 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' started 2021-11-21 23:29:11,234 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:29:11,236 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:29:11,236 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' started 2021-11-21 23:29:11,236 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17' started 2021-11-21 23:29:11,236 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:29:11,236 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' started 2021-11-21 23:29:11,243 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:29:11,244 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:29:11,243 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' started 2021-11-21 23:29:11,244 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' started 2021-11-21 23:29:11,246 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17' started 2021-11-21 23:29:11,244 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:29:11,250 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:29:11,250 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' started 2021-11-21 23:29:11,252 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:29:11,252 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:29:11,252 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' started 2021-11-21 23:29:11,253 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:29:11,252 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17' started 2021-11-21 23:29:11,253 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:29:11,253 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:29:11,253 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17' started 2021-11-21 23:29:11,255 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:29:11,253 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' started 2021-11-21 23:29:11,255 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' started 2021-11-21 23:29:11,256 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' started 2021-11-21 23:29:11,256 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:29:11,256 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' started 2021-11-21 23:29:11,257 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:29:11,257 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17' started 2021-11-21 23:29:11,259 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:29:11,259 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:29:11,259 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:29:11,260 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' started 2021-11-21 23:29:11,260 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' started 2021-11-21 23:29:11,260 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:29:11,260 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17' started 2021-11-21 23:29:11,260 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17' started 2021-11-21 23:29:11,262 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:29:11,263 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' started 2021-11-21 23:29:11,263 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:29:11,263 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17' started 2021-11-21 23:29:11,263 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:29:11,265 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:29:11,265 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17' started 2021-11-21 23:29:11,265 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:29:11,265 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17' started 2021-11-21 23:29:11,266 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:29:11,266 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:29:11,267 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:29:11,269 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:29:11,269 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:29:11,269 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:29:11,270 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:29:11,272 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:29:11,272 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:29:11,273 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:29:11,273 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:29:11,273 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:29:11,275 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:29:11,275 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:29:11,276 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:29:11,276 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:29:11,278 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:29:11,279 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:29:11,279 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:29:11,279 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:29:11,279 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:29:11,280 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:29:11,282 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:29:11,282 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:29:11,282 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:29:11,283 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18 2021-11-21 23:29:11,283 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18 2021-11-21 23:29:11,285 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18 2021-11-21 23:29:11,286 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18 2021-11-21 23:29:11,286 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18 2021-11-21 23:29:11,286 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18 2021-11-21 23:29:11,286 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18 2021-11-21 23:29:11,288 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18 2021-11-21 23:29:11,288 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18 2021-11-21 23:29:11,289 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18 2021-11-21 23:29:11,289 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18 2021-11-21 23:29:11,289 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18 2021-11-21 23:29:11,289 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18 2021-11-21 23:29:11,290 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18 2021-11-21 23:29:11,290 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:29:11,292 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:29:11,292 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:29:11,292 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:29:11,292 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:29:11,292 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:29:11,293 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19 2021-11-21 23:29:11,293 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19 2021-11-21 23:29:11,295 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19 2021-11-21 23:29:11,295 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19 2021-11-21 23:29:11,296 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19 2021-11-21 23:29:11,296 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19 2021-11-21 23:29:11,296 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:29:11,743 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:29:11,749 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:11,750 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:13,229 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:29:13,234 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:13,236 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:14,680 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 359.700000 2021-11-21 23:29:14,686 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:14,687 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:16,178 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 359.700000 2021-11-21 23:29:16,184 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:16,184 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:17,684 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 359.700000 2021-11-21 23:29:17,691 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:17,693 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:19,164 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 359.700000 2021-11-21 23:29:19,168 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:19,170 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:20,631 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 359.700000 2021-11-21 23:29:20,637 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:20,638 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:22,048 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2855.000000 2021-11-21 23:29:22,053 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:22,053 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:23,503 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:23,509 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:23,509 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:25,000 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:25,006 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:25,006 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:26,510 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:26,517 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:26,519 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:27,983 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:27,989 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:27,989 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:29,496 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:29,503 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:29,503 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:31,010 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5151.800000 2021-11-21 23:29:31,016 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:31,016 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:32,454 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5108.200000 2021-11-21 23:29:32,460 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:32,460 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:33,953 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:33,959 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:33,960 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:35,426 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:35,430 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:35,431 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:36,901 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:36,907 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:36,907 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:38,381 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:38,388 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:38,388 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:39,881 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:39,885 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:39,887 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:41,354 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4611.700000 2021-11-21 23:29:41,359 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:41,359 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:42,845 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4130.700000 2021-11-21 23:29:42,851 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:42,852 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:44,342 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4214.300000 2021-11-21 23:29:44,348 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:44,349 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:45,832 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4214.300000 2021-11-21 23:29:45,838 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:45,838 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:47,342 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4214.300000 2021-11-21 23:29:47,348 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:47,348 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:48,819 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4214.300000 2021-11-21 23:29:48,825 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:48,826 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:50,266 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4214.300000 2021-11-21 23:29:50,273 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:50,273 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:51,773 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4698.300000 2021-11-21 23:29:51,779 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:51,779 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:53,246 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4698.300000 2021-11-21 23:29:53,252 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:53,253 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:54,703 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4807.100000 2021-11-21 23:29:54,710 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:54,710 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:56,183 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4807.100000 2021-11-21 23:29:56,188 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:56,190 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:57,663 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4807.100000 2021-11-21 23:29:57,668 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:57,670 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:29:59,180 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4807.100000 2021-11-21 23:29:59,187 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:29:59,187 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:00,684 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4807.100000 2021-11-21 23:30:00,690 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:00,690 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:02,203 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4626.700000 2021-11-21 23:30:02,213 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:02,213 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:03,691 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:03,697 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:03,698 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:05,170 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:05,178 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:05,178 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:06,681 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:06,688 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:06,690 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:08,148 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:08,154 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:08,155 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:09,640 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:09,647 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:09,647 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:11,130 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.700000 2021-11-21 23:30:11,135 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:11,135 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:12,647 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4571.200000 2021-11-21 23:30:12,651 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:12,653 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:14,117 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4548.000000 2021-11-21 23:30:14,124 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:14,125 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:15,589 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4548.000000 2021-11-21 23:30:15,595 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:15,596 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:17,072 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4548.000000 2021-11-21 23:30:17,078 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:17,079 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:18,568 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4548.000000 2021-11-21 23:30:18,572 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:18,573 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:20,078 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4548.000000 2021-11-21 23:30:20,084 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:20,085 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:21,650 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.100000 2021-11-21 23:30:21,655 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:21,655 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:23,131 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4572.100000 2021-11-21 23:30:23,137 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:23,137 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:24,631 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4644.400000 2021-11-21 23:30:24,637 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:24,638 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:26,154 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4644.400000 2021-11-21 23:30:26,158 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:26,158 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:27,742 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4644.400000 2021-11-21 23:30:27,747 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:27,749 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:29,180 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4644.400000 2021-11-21 23:30:29,184 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:29,184 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:30,642 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4644.400000 2021-11-21 23:30:30,648 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:30,650 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:32,119 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4708.600000 2021-11-21 23:30:32,127 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:32,128 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:33,585 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:33,592 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:33,592 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:35,033 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:35,039 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:35,039 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:36,552 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:36,556 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:36,556 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:38,019 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:38,025 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:38,025 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:39,486 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:39,493 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:39,493 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:40,970 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4663.900000 2021-11-21 23:30:40,976 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:40,976 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:42,493 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4552.500000 2021-11-21 23:30:42,500 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:42,500 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:43,923 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:43,927 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:43,928 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:45,378 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:45,384 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:45,385 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:46,848 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:46,855 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:46,855 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:48,319 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:48,325 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:48,325 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:49,753 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:49,760 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:49,762 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:51,236 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4528.900000 2021-11-21 23:30:51,243 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:51,243 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:52,687 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4626.800000 2021-11-21 23:30:52,694 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:52,694 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:54,174 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4705.400000 2021-11-21 23:30:54,180 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:54,180 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:55,690 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4705.400000 2021-11-21 23:30:55,697 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:55,697 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:57,171 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4705.400000 2021-11-21 23:30:57,177 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:57,178 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:30:58,598 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4705.400000 2021-11-21 23:30:58,604 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:30:58,605 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:00,071 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4705.400000 2021-11-21 23:31:00,078 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:00,078 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:01,720 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.800000 2021-11-21 23:31:01,726 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:01,727 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:03,233 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.800000 2021-11-21 23:31:03,240 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:03,240 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:04,696 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.800000 2021-11-21 23:31:04,701 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:04,703 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:06,147 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.800000 2021-11-21 23:31:06,153 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:06,154 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:07,615 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.800000 2021-11-21 23:31:07,621 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:07,622 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:09,053 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' completed 2021-11-21 23:31:09,055 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17' started 2021-11-21 23:31:09,086 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.800000 2021-11-21 23:31:09,094 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:09,095 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:09,180 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' completed 2021-11-21 23:31:09,181 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17' started 2021-11-21 23:31:09,207 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' completed 2021-11-21 23:31:09,207 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17' started 2021-11-21 23:31:09,401 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' completed 2021-11-21 23:31:09,403 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17' started 2021-11-21 23:31:09,482 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' completed 2021-11-21 23:31:09,483 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17' started 2021-11-21 23:31:09,520 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' completed 2021-11-21 23:31:09,522 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17' started 2021-11-21 23:31:09,522 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 are 20000 2021-11-21 23:31:09,523 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1000000 to 1020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:31:09,523 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:31:09,875 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' completed 2021-11-21 23:31:09,875 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17' started 2021-11-21 23:31:09,960 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' completed 2021-11-21 23:31:09,961 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17' started 2021-11-21 23:31:10,068 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' completed 2021-11-21 23:31:10,069 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17' started 2021-11-21 23:31:10,081 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17' completed 2021-11-21 23:31:10,082 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' completed 2021-11-21 23:31:10,082 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17' started 2021-11-21 23:31:10,082 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17' started 2021-11-21 23:31:10,111 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17' completed 2021-11-21 23:31:10,114 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17' started 2021-11-21 23:31:10,121 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16' completed 2021-11-21 23:31:10,122 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17' started 2021-11-21 23:31:10,122 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16 are 20000 2021-11-21 23:31:10,125 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1000000 to 1020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:31:10,125 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:31:10,434 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17' completed 2021-11-21 23:31:10,434 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17' started 2021-11-21 23:31:10,470 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17' completed 2021-11-21 23:31:10,470 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17' started 2021-11-21 23:31:10,546 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' completed 2021-11-21 23:31:10,546 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17' started 2021-11-21 23:31:10,549 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.800000 2021-11-21 23:31:10,555 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:10,555 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:10,615 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' completed 2021-11-21 23:31:10,615 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17' started 2021-11-21 23:31:10,650 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' completed 2021-11-21 23:31:10,651 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17' started 2021-11-21 23:31:10,704 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17' completed 2021-11-21 23:31:10,706 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17' started 2021-11-21 23:31:10,716 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' completed 2021-11-21 23:31:10,717 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17' started 2021-11-21 23:31:10,717 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 are 20000 2021-11-21 23:31:10,717 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1000000 to 1020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16 2021-11-21 23:31:10,719 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:10,782 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17' completed 2021-11-21 23:31:10,783 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18' started 2021-11-21 23:31:10,861 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' completed 2021-11-21 23:31:10,862 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18' started 2021-11-21 23:31:11,079 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17' completed 2021-11-21 23:31:11,081 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18' started 2021-11-21 23:31:11,145 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17' completed 2021-11-21 23:31:11,147 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18' started 2021-11-21 23:31:11,151 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17' completed 2021-11-21 23:31:11,153 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18' started 2021-11-21 23:31:11,153 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17 are 20000 2021-11-21 23:31:11,154 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1020000 to 1040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:11,154 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:11,154 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 are 20000 2021-11-21 23:31:11,155 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1020000 to 1040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:11,157 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:11,157 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 are 20000 2021-11-21 23:31:11,157 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1020000 to 1040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17 2021-11-21 23:31:11,157 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,158 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 are 20000 2021-11-21 23:31:11,160 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1040000 to 1060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,160 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,161 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17 are 20000 2021-11-21 23:31:11,161 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1040000 to 1060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,161 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,161 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 are 20000 2021-11-21 23:31:11,163 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1040000 to 1060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17 2021-11-21 23:31:11,163 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,280 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' completed 2021-11-21 23:31:11,282 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18' started 2021-11-21 23:31:11,282 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 are 20000 2021-11-21 23:31:11,282 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1060000 to 1080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,283 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,285 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17 are 20000 2021-11-21 23:31:11,285 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1060000 to 1080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,286 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,286 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 are 20000 2021-11-21 23:31:11,286 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1060000 to 1080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17 2021-11-21 23:31:11,286 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,288 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 are 20000 2021-11-21 23:31:11,288 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1080000 to 1100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,289 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,289 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17 are 20000 2021-11-21 23:31:11,289 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1080000 to 1100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,290 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,292 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 are 20000 2021-11-21 23:31:11,292 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1080000 to 1100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17 2021-11-21 23:31:11,292 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,292 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17 are 20000 2021-11-21 23:31:11,293 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1100000 to 1120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,293 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,295 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 are 20000 2021-11-21 23:31:11,296 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1100000 to 1120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,296 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,296 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 are 20000 2021-11-21 23:31:11,296 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1100000 to 1120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17 2021-11-21 23:31:11,298 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,299 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 are 20000 2021-11-21 23:31:11,299 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1120000 to 1140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,299 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,301 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17 are 20000 2021-11-21 23:31:11,301 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1120000 to 1140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,302 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,302 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 are 20000 2021-11-21 23:31:11,302 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1140000 to 1160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,303 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,303 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 are 20000 2021-11-21 23:31:11,305 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1120000 to 1140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17 2021-11-21 23:31:11,305 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,569 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17' completed 2021-11-21 23:31:11,571 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18' started 2021-11-21 23:31:11,571 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17 are 20000 2021-11-21 23:31:11,572 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1140000 to 1160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,572 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:31:11,573 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17 are 20000 2021-11-21 23:31:11,573 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1160000 to 1180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:31:11,575 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,575 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 are 20000 2021-11-21 23:31:11,576 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1140000 to 1160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17 2021-11-21 23:31:11,576 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:31:11,578 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17 are 20000 2021-11-21 23:31:11,578 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1160000 to 1180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17 2021-11-21 23:31:11,579 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:31:11,865 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17' completed 2021-11-21 23:31:11,867 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18' started 2021-11-21 23:31:11,867 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17 are 20000 2021-11-21 23:31:11,868 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1180000 to 1200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:31:11,868 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:31:11,869 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17 are 20000 2021-11-21 23:31:11,869 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1180000 to 1200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17 2021-11-21 23:31:11,871 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:31:12,040 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4899.300000 2021-11-21 23:31:12,046 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:12,046 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:13,474 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:13,480 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:13,480 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:14,970 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:14,976 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:14,977 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:16,477 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:16,483 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:16,484 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:17,983 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:17,990 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:17,990 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:19,476 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:19,482 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:19,482 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:20,941 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4796.900000 2021-11-21 23:31:20,948 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:20,950 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:22,385 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4836.300000 2021-11-21 23:31:22,391 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:22,392 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:23,892 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:23,898 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:23,900 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:25,365 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:25,371 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:25,371 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:26,846 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:26,851 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:26,852 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:28,359 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:28,365 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:28,367 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:29,806 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:29,812 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:29,813 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:31,325 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4945.900000 2021-11-21 23:31:31,329 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:31,331 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:32,854 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5017.200000 2021-11-21 23:31:32,859 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:32,861 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:34,365 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5054.500000 2021-11-21 23:31:34,369 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:34,371 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:35,878 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5054.500000 2021-11-21 23:31:35,884 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:35,884 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:37,428 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5054.500000 2021-11-21 23:31:37,434 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:37,436 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:38,891 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5054.500000 2021-11-21 23:31:38,897 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:38,898 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:40,372 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5054.500000 2021-11-21 23:31:40,378 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:40,380 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:41,926 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5073.600000 2021-11-21 23:31:41,931 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:41,931 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:43,427 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5073.600000 2021-11-21 23:31:43,434 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:43,436 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:44,877 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5081.200000 2021-11-21 23:31:44,882 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:44,884 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:46,509 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5081.200000 2021-11-21 23:31:46,515 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:46,516 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:47,982 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5081.200000 2021-11-21 23:31:47,987 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:47,989 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:49,448 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5081.200000 2021-11-21 23:31:49,454 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:49,456 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:50,994 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5081.200000 2021-11-21 23:31:51,002 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:51,003 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:52,456 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 5028.400000 2021-11-21 23:31:52,461 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:52,461 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:53,976 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:31:53,982 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:53,983 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:55,433 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:31:55,438 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:55,440 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:56,983 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:31:56,989 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:56,990 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:58,448 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:31:58,453 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:58,454 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:31:59,907 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:31:59,914 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:31:59,914 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:01,447 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4976.900000 2021-11-21 23:32:01,451 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:01,453 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:02,937 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4924.100000 2021-11-21 23:32:02,944 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:02,944 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:04,407 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.600000 2021-11-21 23:32:04,411 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:04,413 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:05,875 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.600000 2021-11-21 23:32:05,881 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:05,882 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:07,418 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.600000 2021-11-21 23:32:07,424 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:07,424 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:08,903 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.600000 2021-11-21 23:32:08,910 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:08,911 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:10,411 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4854.600000 2021-11-21 23:32:10,417 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:10,418 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:11,917 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4709.100000 2021-11-21 23:32:11,921 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:11,921 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:13,385 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4709.100000 2021-11-21 23:32:13,391 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:13,391 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:14,907 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4624.100000 2021-11-21 23:32:14,913 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:14,913 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:16,338 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4624.100000 2021-11-21 23:32:16,344 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:16,345 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:17,782 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4624.100000 2021-11-21 23:32:17,789 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:17,789 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:19,263 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4624.100000 2021-11-21 23:32:19,269 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:19,269 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:20,713 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4624.100000 2021-11-21 23:32:20,719 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:20,720 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:22,197 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.600000 2021-11-21 23:32:22,203 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:22,204 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:23,671 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:23,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:23,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:25,115 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:25,121 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:25,121 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:26,723 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:26,727 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:26,727 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:28,223 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:28,229 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:28,229 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:29,747 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:29,753 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:29,753 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:31,265 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4778.100000 2021-11-21 23:32:31,269 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:31,270 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:32,717 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4802.000000 2021-11-21 23:32:32,723 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:32,723 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:34,211 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:32:34,220 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:34,220 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:35,673 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:32:35,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:35,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:37,144 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:32:37,148 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:37,148 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:38,615 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:32:38,619 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:38,619 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:40,072 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4790.700000 2021-11-21 23:32:40,078 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:40,078 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:41,678 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.800000 2021-11-21 23:32:41,686 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:41,687 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:43,160 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4805.800000 2021-11-21 23:32:43,165 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:43,167 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:44,647 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4874.700000 2021-11-21 23:32:44,653 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:44,653 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:46,109 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4874.700000 2021-11-21 23:32:46,115 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:46,117 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:47,582 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4874.700000 2021-11-21 23:32:47,588 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:47,588 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:49,125 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4874.700000 2021-11-21 23:32:49,131 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:49,132 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:50,611 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4874.700000 2021-11-21 23:32:50,618 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:50,618 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:52,141 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4893.700000 2021-11-21 23:32:52,148 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:52,148 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:53,650 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:32:53,654 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:53,654 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:55,154 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:32:55,161 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:55,161 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:56,720 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:32:56,726 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:56,726 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:58,200 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:32:58,206 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:58,207 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:32:59,779 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:32:59,785 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:32:59,786 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:01,252 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4849.700000 2021-11-21 23:33:01,259 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:01,259 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:02,785 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4794.300000 2021-11-21 23:33:02,789 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:02,790 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:03,869 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17' completed 2021-11-21 23:33:03,871 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18' started 2021-11-21 23:33:04,019 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17' completed 2021-11-21 23:33:04,019 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18' started 2021-11-21 23:33:04,280 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.800000 2021-11-21 23:33:04,286 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:04,286 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:04,388 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17' completed 2021-11-21 23:33:04,388 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18' started 2021-11-21 23:33:04,390 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17 are 20000 2021-11-21 23:33:04,391 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1200000 to 1220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:33:04,391 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:33:04,391 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17 are 20000 2021-11-21 23:33:04,392 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1200000 to 1220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17 2021-11-21 23:33:04,392 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:33:04,457 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17' completed 2021-11-21 23:33:04,457 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18' started 2021-11-21 23:33:04,500 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17' completed 2021-11-21 23:33:04,502 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18' started 2021-11-21 23:33:04,532 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17' completed 2021-11-21 23:33:04,533 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18' started 2021-11-21 23:33:04,533 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17 are 20000 2021-11-21 23:33:04,533 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1220000 to 1240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:33:04,535 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:33:04,536 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17 are 20000 2021-11-21 23:33:04,536 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1220000 to 1240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17 2021-11-21 23:33:04,536 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:33:04,538 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17 are 20000 2021-11-21 23:33:04,538 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1240000 to 1260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:33:04,539 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:33:04,713 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17' completed 2021-11-21 23:33:04,716 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18' started 2021-11-21 23:33:04,808 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18' completed 2021-11-21 23:33:04,809 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18' started 2021-11-21 23:33:04,809 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17' completed 2021-11-21 23:33:04,812 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18' started 2021-11-21 23:33:04,812 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17 are 20000 2021-11-21 23:33:04,812 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1240000 to 1260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17 2021-11-21 23:33:04,813 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:33:04,969 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17' completed 2021-11-21 23:33:04,970 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18' started 2021-11-21 23:33:05,032 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17' completed 2021-11-21 23:33:05,032 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18' started 2021-11-21 23:33:05,108 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17' completed 2021-11-21 23:33:05,108 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18' started 2021-11-21 23:33:05,109 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17 are 20000 2021-11-21 23:33:05,111 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1260000 to 1280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:33:05,111 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:33:05,157 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17' completed 2021-11-21 23:33:05,158 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18' started 2021-11-21 23:33:05,178 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18' completed 2021-11-21 23:33:05,180 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18' started 2021-11-21 23:33:05,365 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18' completed 2021-11-21 23:33:05,368 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18' started 2021-11-21 23:33:05,374 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17' completed 2021-11-21 23:33:05,375 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18' started 2021-11-21 23:33:05,411 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18' completed 2021-11-21 23:33:05,411 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18' started 2021-11-21 23:33:05,417 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18' completed 2021-11-21 23:33:05,418 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18' started 2021-11-21 23:33:05,533 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18' completed 2021-11-21 23:33:05,535 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19' started 2021-11-21 23:33:05,551 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17' completed 2021-11-21 23:33:05,551 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19' started 2021-11-21 23:33:05,552 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17 are 20000 2021-11-21 23:33:05,552 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1260000 to 1280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17 2021-11-21 23:33:05,552 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:33:05,552 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17 are 20000 2021-11-21 23:33:05,553 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1280000 to 1300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:33:05,553 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:33:05,676 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17' completed 2021-11-21 23:33:05,677 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19' started 2021-11-21 23:33:05,711 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17' completed 2021-11-21 23:33:05,713 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19' started 2021-11-21 23:33:05,799 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.800000 2021-11-21 23:33:05,803 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:05,805 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:06,052 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17' completed 2021-11-21 23:33:06,052 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19' started 2021-11-21 23:33:06,052 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17 are 20000 2021-11-21 23:33:06,053 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1280000 to 1300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17 2021-11-21 23:33:06,055 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:33:06,055 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17 are 20000 2021-11-21 23:33:06,055 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1300000 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:33:06,056 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:33:06,056 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17 are 20000 2021-11-21 23:33:06,058 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1300000 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17 2021-11-21 23:33:06,058 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:33:06,059 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17 are 20000 2021-11-21 23:33:06,059 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:33:06,059 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:33:06,061 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17 are 20000 2021-11-21 23:33:06,062 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17 2021-11-21 23:33:06,062 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:33:06,069 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18' completed 2021-11-21 23:33:06,069 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19' started 2021-11-21 23:33:06,483 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17' completed 2021-11-21 23:33:06,507 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17' completed 2021-11-21 23:33:06,523 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17' completed 2021-11-21 23:33:06,525 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17 are 20000 2021-11-21 23:33:06,525 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1340000 to 1360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:33:06,526 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:33:06,526 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17 are 20000 2021-11-21 23:33:06,526 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1340000 to 1360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17 2021-11-21 23:33:06,526 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:33:06,528 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17 are 20000 2021-11-21 23:33:06,529 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1360000 to 1380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:33:06,529 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:33:06,529 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17 are 20000 2021-11-21 23:33:06,529 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1360000 to 1380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17 2021-11-21 23:33:06,530 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:33:06,532 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17 are 20000 2021-11-21 23:33:06,532 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1380000 to 1400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:33:06,532 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:33:06,532 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17 are 20000 2021-11-21 23:33:06,533 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1380000 to 1400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17 2021-11-21 23:33:06,533 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:33:06,535 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18 are 20000 2021-11-21 23:33:06,535 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1160000 to 1180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:33:06,536 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:33:06,536 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18 are 20000 2021-11-21 23:33:06,536 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1180000 to 1200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:33:06,536 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:33:06,538 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18 are 20000 2021-11-21 23:33:06,538 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1200000 to 1220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:33:06,539 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:33:06,539 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18 are 20000 2021-11-21 23:33:06,539 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1220000 to 1240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:33:06,540 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:33:06,540 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18 are 20000 2021-11-21 23:33:06,542 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1240000 to 1260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:33:06,542 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:33:06,543 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18 are 20000 2021-11-21 23:33:06,543 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1260000 to 1280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:33:06,545 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18 2021-11-21 23:33:07,203 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.800000 2021-11-21 23:33:07,209 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:07,210 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:08,687 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.800000 2021-11-21 23:33:08,693 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:08,694 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:09,908 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18' completed 2021-11-21 23:33:09,910 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18 are 20000 2021-11-21 23:33:09,911 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1000000 to 1020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18 2021-11-21 23:33:09,913 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18 2021-11-21 23:33:09,913 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18 are 20000 2021-11-21 23:33:09,914 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1280000 to 1300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18 2021-11-21 23:33:09,914 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18 2021-11-21 23:33:10,135 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.800000 2021-11-21 23:33:10,141 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:10,141 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:11,591 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4723.400000 2021-11-21 23:33:11,596 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:11,596 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:13,036 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4723.400000 2021-11-21 23:33:13,042 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:13,042 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:14,470 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4653.000000 2021-11-21 23:33:14,476 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:14,476 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:15,990 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4653.000000 2021-11-21 23:33:15,996 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:15,996 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:17,444 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4653.000000 2021-11-21 23:33:17,450 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:17,450 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:18,951 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4653.000000 2021-11-21 23:33:18,957 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:18,957 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:20,371 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4653.000000 2021-11-21 23:33:20,378 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:20,380 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:21,913 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.500000 2021-11-21 23:33:21,918 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:21,918 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:23,421 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4538.500000 2021-11-21 23:33:23,427 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:23,427 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:24,905 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:33:24,913 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:24,913 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:26,345 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:33:26,351 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:26,352 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:27,821 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:33:27,826 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:27,826 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:29,299 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:33:29,305 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:29,305 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:30,802 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:33:30,809 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:30,809 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:32,351 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4531.600000 2021-11-21 23:33:32,355 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:32,357 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:33,823 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:33,828 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:33,829 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:35,335 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:35,342 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:35,342 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:36,805 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:36,811 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:36,811 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:38,308 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:38,313 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:38,315 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:39,839 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:39,845 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:39,846 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:41,311 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4516.000000 2021-11-21 23:33:41,315 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:41,315 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:42,789 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.800000 2021-11-21 23:33:42,795 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:42,796 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:44,260 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4199.100000 2021-11-21 23:33:44,266 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:44,267 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:45,733 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4199.100000 2021-11-21 23:33:45,740 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:45,740 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:47,220 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4199.100000 2021-11-21 23:33:47,226 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:47,226 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:48,671 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4199.100000 2021-11-21 23:33:48,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:48,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:50,115 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4199.100000 2021-11-21 23:33:50,119 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:50,119 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:51,588 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3829.100000 2021-11-21 23:33:51,594 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:51,595 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:53,032 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3829.100000 2021-11-21 23:33:53,039 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:53,039 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:54,493 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3992.300000 2021-11-21 23:33:54,500 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:54,500 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:56,002 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3992.300000 2021-11-21 23:33:56,009 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:56,009 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:57,454 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3992.300000 2021-11-21 23:33:57,461 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:57,463 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:33:58,874 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3992.300000 2021-11-21 23:33:58,880 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:33:58,881 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:00,355 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3992.300000 2021-11-21 23:34:00,361 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:00,361 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:01,829 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4158.300000 2021-11-21 23:34:01,835 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:01,836 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:03,312 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4158.300000 2021-11-21 23:34:03,318 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:03,319 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:04,736 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3850.500000 2021-11-21 23:34:04,740 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:04,740 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:06,219 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3850.500000 2021-11-21 23:34:06,224 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:06,224 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:07,687 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3850.500000 2021-11-21 23:34:07,691 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:07,693 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:09,161 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3850.500000 2021-11-21 23:34:09,167 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:09,167 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:10,671 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3850.500000 2021-11-21 23:34:10,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:10,677 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:12,122 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3732.000000 2021-11-21 23:34:12,128 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:12,128 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:13,569 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:13,575 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:13,575 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:15,069 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:15,075 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:15,075 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:16,516 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:16,523 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:16,523 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:17,948 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:17,953 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:17,953 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:19,463 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:19,467 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:19,469 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:20,891 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3946.500000 2021-11-21 23:34:20,895 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:20,895 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:22,365 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4147.200000 2021-11-21 23:34:22,369 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:22,371 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:23,871 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:23,878 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:23,878 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:25,325 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:25,332 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:25,332 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:26,789 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:26,796 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:26,796 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:28,260 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:28,266 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:28,266 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:29,667 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:29,674 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:29,674 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:31,213 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3841.600000 2021-11-21 23:34:31,219 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:31,219 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:32,701 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2952.600000 2021-11-21 23:34:32,707 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:32,707 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:34,207 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2551.200000 2021-11-21 23:34:34,213 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:34,213 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:35,681 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2551.200000 2021-11-21 23:34:35,686 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:35,687 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:37,151 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2551.200000 2021-11-21 23:34:37,155 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:37,157 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:38,619 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2551.200000 2021-11-21 23:34:38,625 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:38,625 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:40,158 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2551.200000 2021-11-21 23:34:40,165 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:40,167 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:41,665 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2834.700000 2021-11-21 23:34:41,671 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:41,671 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:43,125 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 2834.700000 2021-11-21 23:34:43,131 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:43,131 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:44,591 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3106.100000 2021-11-21 23:34:44,596 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:44,596 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:46,117 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3106.100000 2021-11-21 23:34:46,121 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:46,122 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:47,621 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3106.100000 2021-11-21 23:34:47,627 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:47,627 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:49,117 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3106.100000 2021-11-21 23:34:49,122 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:49,124 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:50,627 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3106.100000 2021-11-21 23:34:50,632 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:50,634 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:52,200 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 3593.000000 2021-11-21 23:34:52,207 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:52,209 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:53,661 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:34:53,665 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:53,665 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:55,071 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:34:55,075 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:55,076 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:56,545 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:34:56,549 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:56,551 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:58,007 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:34:58,013 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:58,015 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:34:59,536 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:34:59,543 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:34:59,543 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:01,009 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.400000 2021-11-21 23:35:01,016 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:35:01,016 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:02,467 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4360.500000 2021-11-21 23:35:02,471 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:35:02,473 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:03,959 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4603.700000 2021-11-21 23:35:03,963 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:35:03,964 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:04,611 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18' completed 2021-11-21 23:35:04,635 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18' completed 2021-11-21 23:35:05,101 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18' completed 2021-11-21 23:35:05,102 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18 are 20000 2021-11-21 23:35:05,102 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1020000 to 1040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18 2021-11-21 23:35:05,104 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18 2021-11-21 23:35:05,404 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4603.700000 2021-11-21 23:35:05,410 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:35:05,410 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:05,575 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18' completed 2021-11-21 23:35:05,576 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18 are 20000 2021-11-21 23:35:05,578 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1300000 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18 2021-11-21 23:35:05,578 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18 2021-11-21 23:35:05,578 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18' completed 2021-11-21 23:35:05,578 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18 are 20000 2021-11-21 23:35:05,581 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1040000 to 1060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18 2021-11-21 23:35:05,582 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18 2021-11-21 23:35:05,647 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18' completed 2021-11-21 23:35:05,723 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18' completed 2021-11-21 23:35:05,740 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18' completed 2021-11-21 23:35:05,769 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18' completed 2021-11-21 23:35:05,828 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18' completed 2021-11-21 23:35:05,858 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18' completed 2021-11-21 23:35:05,861 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18' completed 2021-11-21 23:35:05,861 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18 are 20000 2021-11-21 23:35:05,861 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18 2021-11-21 23:35:05,862 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18 2021-11-21 23:35:05,862 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18 are 20000 2021-11-21 23:35:05,864 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1060000 to 1080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18 2021-11-21 23:35:05,864 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18 2021-11-21 23:35:05,865 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18 are 20000 2021-11-21 23:35:05,865 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1340000 to 1360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18 2021-11-21 23:35:05,865 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18 2021-11-21 23:35:05,865 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18 are 20000 2021-11-21 23:35:05,867 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1080000 to 1100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18 2021-11-21 23:35:05,867 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18 2021-11-21 23:35:05,926 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18' completed 2021-11-21 23:35:05,927 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18 are 20000 2021-11-21 23:35:05,927 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1360000 to 1380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18 2021-11-21 23:35:05,927 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18 2021-11-21 23:35:05,928 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18 are 20000 2021-11-21 23:35:05,928 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1380000 to 1400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18 2021-11-21 23:35:05,930 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18 2021-11-21 23:35:05,990 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18' completed 2021-11-21 23:35:05,990 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18 are 20000 2021-11-21 23:35:05,990 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1100000 to 1120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18 2021-11-21 23:35:05,992 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18 2021-11-21 23:35:05,992 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18 are 20000 2021-11-21 23:35:05,993 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1120000 to 1140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18 2021-11-21 23:35:05,993 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18 2021-11-21 23:35:05,993 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18 are 20000 2021-11-21 23:35:05,993 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1140000 to 1160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18 2021-11-21 23:35:05,994 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:35:06,098 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19' completed 2021-11-21 23:35:06,122 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19' completed 2021-11-21 23:35:06,130 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18' completed 2021-11-21 23:35:06,204 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19' completed 2021-11-21 23:35:06,226 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19' completed 2021-11-21 23:35:06,305 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18' completed 2021-11-21 23:35:06,305 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18 are 20000 2021-11-21 23:35:06,306 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1160000 to 1180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18 2021-11-21 23:35:06,306 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:35:06,473 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18' completed 2021-11-21 23:35:06,474 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18 are 20000 2021-11-21 23:35:06,474 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1180000 to 1200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18 2021-11-21 23:35:06,476 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:35:06,476 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18 are 20000 2021-11-21 23:35:06,476 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1200000 to 1220000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18 2021-11-21 23:35:06,476 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:35:06,596 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19' completed 2021-11-21 23:35:06,619 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18' completed 2021-11-21 23:35:06,621 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18 are 20000 2021-11-21 23:35:06,621 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1220000 to 1240000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18 2021-11-21 23:35:06,621 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:35:06,621 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18 are 20000 2021-11-21 23:35:06,622 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1240000 to 1260000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18 2021-11-21 23:35:06,622 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:35:06,624 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18 are 20000 2021-11-21 23:35:06,625 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1260000 to 1280000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18 2021-11-21 23:35:06,625 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19 2021-11-21 23:35:06,625 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19 are 20000 2021-11-21 23:35:06,625 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1280000 to 1300000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19 2021-11-21 23:35:06,627 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19 2021-11-21 23:35:06,627 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19 are 20000 2021-11-21 23:35:06,628 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1300000 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19 2021-11-21 23:35:06,628 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19 2021-11-21 23:35:06,628 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19 are 20000 2021-11-21 23:35:06,628 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1340000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19 2021-11-21 23:35:06,628 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19 2021-11-21 23:35:06,630 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19 are 20000 2021-11-21 23:35:06,631 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1340000 to 1360000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19 2021-11-21 23:35:06,631 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19 2021-11-21 23:35:06,631 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19 are 20000 2021-11-21 23:35:06,631 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1360000 to 1380000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19 2021-11-21 23:35:06,632 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19 2021-11-21 23:35:06,868 | test | DEBUG | pool-3-thread-23 | [task:record_bucket_ops:3570] Ops rate for 'default': 4603.700000 2021-11-21 23:35:06,871 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:35:06,872 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:35:06,911 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19' completed 2021-11-21 23:35:06,911 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19 are 20000 2021-11-21 23:35:06,913 | test | DEBUG | pool-3-thread-8 | [task:execute_tasks:3915] Failed to load 0 docs from 1380000 to 1400000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19 2021-11-21 23:35:06,913 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637566151.19 2021-11-21 23:35:07,880 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'default' +----------+-----------------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-----------------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **......*****.................................................*.............................................*****X | 5151.800 | | 5108.200 | ..................................................................................................X | 5108.200 | | 4611.700 | ........................................................................................*****X | 4611.700 | | 4130.700 | ...............................................................................*.*****..........**..****X | 4807.100 | | 4626.700 | ........................................................................................X | 4626.700 | | 4572.700 | .......................................................................................*****X | 4572.700 | | 4571.200 | .......................................................................................X | 4571.200 | | 4548.000 | .......................................................................................*******..*****.X | 4708.600 | | 4663.900 | .........................................................................................*****X | 4663.900 | | 4552.500 | .......................................................................................X | 4552.500 | | 4528.900 | ......................................................................................******..*..*****..**...****X | 4957.800 | | 4899.300 | ..............................................................................................X | 4899.300 | | 4796.900 | ............................................................................................*******...******.*.***********X | 5081.200 | | 5028.400 | ................................................................................................X | 5028.400 | | 4976.900 | ...............................................................................................*****X | 4976.900 | | 4924.100 | ..............................................................................................X | 4924.100 | | 4854.600 | .............................................................................................****X | 4854.600 | | 4709.100 | ..........................................................................................*X | 4709.100 | | 4624.100 | ........................................................................................*****..*.******.X | 4802.000 | | 4790.700 | ...........................................................................................*****.**.*****X | 4893.700 | | 4849.700 | .............................................................................................*****X | 4849.700 | | 4794.300 | ............................................................................................X | 4794.300 | | 4762.800 | ...........................................................................................****X | 4762.800 | | 4723.400 | ..........................................................................................*X | 4723.400 | | 4653.000 | .........................................................................................****X | 4653.000 | | 4538.500 | .......................................................................................*X | 4538.500 | | 4487.400 | ......................................................................................*****X | 4531.600 | | 4516.000 | ......................................................................................*****X | 4516.000 | | 4463.800 | .....................................................................................X | 4463.800 | | 4199.100 | ................................................................................****X | 4199.100 | | 3829.100 | .........................................................................**...*****...*X | 4158.300 | | 3850.500 | .........................................................................****X | 3850.500 | | 3732.000 | .......................................................................*....******....X | 4147.200 | | 3841.600 | .........................................................................*****X | 3841.600 | | 2952.600 | ........................................................X | 2952.600 | | 2551.200 | ................................................*****......**.....*****.........*.........******......*.....**X | 4603.700 | +----------+-----------------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:35:07,881 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637566151.19' completed 2021-11-21 23:35:07,881 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:35:07,882 | infra | WARNING | pool-3-thread-8 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637566151.05' not completed 2021-11-21 23:35:07,882 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:35:07,884 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' complete. Loaded 20000 items 2021-11-21 23:35:07,884 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1000000_1020000_1637566151.16' complete. Loaded 20000 items 2021-11-21 23:35:07,884 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1000000_1020000_1637566151.16' complete. Loaded 20000 items 2021-11-21 23:35:07,884 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1020000_1040000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,885 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,885 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1020000_1040000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,887 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,887 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1040000_1060000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,888 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1040000_1060000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,888 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,888 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1060000_1080000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,888 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1060000_1080000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,890 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,890 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1080000_1100000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,890 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1080000_1100000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,891 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1100000_1120000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,891 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,891 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1100000_1120000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,891 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,892 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1120000_1140000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,892 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,894 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1120000_1140000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,894 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1140000_1160000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,894 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,895 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1140000_1160000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,895 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1160000_1180000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,897 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,898 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1180000_1200000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,898 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1200000_1220000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,898 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,898 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1220000_1240000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,900 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,900 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1240000_1260000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,901 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,901 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1260000_1280000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,901 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,903 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,903 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1280000_1300000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,904 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1300000_1320000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,904 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,904 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1320000_1340000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,904 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,905 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1340000_1360000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,905 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,907 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1360000_1380000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,907 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,907 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default__default_ttl=0_create_NONE_1380000_1400000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,907 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default__default_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.17' complete. Loaded 20000 items 2021-11-21 23:35:07,908 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1160000_1180000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,908 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1180000_1200000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,908 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1200000_1220000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,910 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1220000_1240000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,910 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1240000_1260000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,911 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1260000_1280000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,911 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1000000_1020000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,911 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1280000_1300000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,913 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1020000_1040000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,913 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1300000_1320000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,914 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1040000_1060000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,914 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1320000_1340000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,914 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1060000_1080000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,914 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1340000_1360000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,914 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1080000_1100000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,915 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1360000_1380000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,915 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1380000_1400000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,917 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1100000_1120000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,917 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1120000_1140000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,917 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1140000_1160000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,918 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1160000_1180000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,918 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1180000_1200000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,918 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1200000_1220000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,920 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1220000_1240000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,920 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1240000_1260000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,921 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1260000_1280000_1637566151.18' complete. Loaded 20000 items 2021-11-21 23:35:07,921 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1280000_1300000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,921 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1300000_1320000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,921 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1320000_1340000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,923 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1340000_1360000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,923 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1360000_1380000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,924 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566151.05_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1380000_1400000_1637566151.19' complete. Loaded 20000 items 2021-11-21 23:35:07,960 | infra | INFO | pool-3-thread-8 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637566507.92 2021-11-21 23:35:07,960 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'PrintBucketStats_default_1637566507.92' started 2021-11-21 23:35:07,960 | infra | DEBUG | pool-3-thread-8 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637566507.92 2021-11-21 23:35:07,961 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637566507.92' completed 2021-11-21 23:35:07,963 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:35:07,963 | infra | WARNING | pool-3-thread-8 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637566151.05' not completed 2021-11-21 23:35:07,963 | infra | DEBUG | pool-3-thread-8 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:35:07,963 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637566151.05' completed 2021-11-21 23:35:08,144 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:35:08,157 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:35:08,414 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:35:08,713 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:35:08,861 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:35:08,862 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:35:08,894 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:35:08,924 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:35:08,953 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:35:08,993 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:35:09,023 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:35:09,055 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:35:09,086 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:35:09,088 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637566509.09 2021-11-21 23:35:09,088 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637566509.09' started 2021-11-21 23:35:09,089 | infra | DEBUG | pool-3-thread-17 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:35:09,104 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:35:09,517 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:35:09,825 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:35:09,966 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:35:09,967 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:35:09,994 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:35:10,023 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:35:10,052 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:35:10,088 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:35:10,118 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:35:10,148 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:35:10,180 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:35:10,180 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637566510.18 2021-11-21 23:35:10,180 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637566510.18' started 2021-11-21 23:35:10,180 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637566509.09 2021-11-21 23:35:10,183 | infra | DEBUG | pool-3-thread-1 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:35:11,502 | test | DEBUG | pool-3-thread-17 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:35:11,502 | test | DEBUG | pool-3-thread-17 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:35:11,503 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637566509.09' completed 2021-11-21 23:35:11,505 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:35:11,506 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637566510.18 2021-11-21 23:35:13,180 | test | DEBUG | pool-3-thread-1 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:35:13,180 | test | DEBUG | pool-3-thread-1 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:35:13,181 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637566510.18' completed 2021-11-21 23:35:13,183 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:35:13,184 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:642] Added items from 1000000 to 1400000 2021-11-21 23:35:13,186 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:35:13,186 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:35:13,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:35:13,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:13,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:13,255 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:35:13,255 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:13,256 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:13,256 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:35:13,256 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:35:13,321 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:35:13,322 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:13,322 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:13,322 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:35:13,322 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:13,323 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:13,323 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:35:13,325 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:35:13,342 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:35:13,344 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:35:23,345 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:35:23,345 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:35:23,417 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:35:23,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:23,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:23,420 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:35:23,420 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:23,421 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:23,421 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:35:23,421 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:35:23,489 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:35:23,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:23,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:23,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:35:23,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:23,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:23,492 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:35:23,492 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:35:23,510 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:35:23,512 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:35:33,512 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:35:33,513 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:35:33,575 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:35:33,576 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:33,576 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:33,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:35:33,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:33,578 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:33,578 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:35:33,579 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:35:33,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:35:33,650 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:33,650 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:33,650 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:35:33,651 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:33,651 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:33,651 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:35:33,651 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:35:33,670 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:35:33,670 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:35:43,671 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:35:43,671 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:35:43,744 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:35:43,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:43,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:43,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:35:43,746 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:43,747 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:43,747 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:35:43,747 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:35:43,816 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:35:43,818 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:43,818 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:43,819 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:35:43,819 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:43,819 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:43,819 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:35:43,821 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:35:43,836 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:35:43,836 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:35:53,838 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:35:53,838 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:35:53,907 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:35:53,907 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:53,907 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:53,908 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:35:53,908 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:53,910 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:53,910 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:35:53,911 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:35:53,973 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:35:53,973 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:53,973 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:53,974 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:35:53,974 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:35:53,976 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:35:53,976 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:35:53,976 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:35:53,993 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:35:53,993 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:03,993 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:03,994 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:04,065 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:04,065 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:04,065 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:04,066 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:04,066 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:04,068 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:04,068 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:04,069 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:04,138 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:04,138 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:04,140 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:04,140 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:04,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:04,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:04,141 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:04,141 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:04,158 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:04,160 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:14,161 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:14,161 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:14,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:14,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:14,233 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:14,234 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:14,234 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:14,236 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:14,236 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:14,236 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:14,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:14,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:14,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:14,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:14,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:14,316 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:14,316 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:14,318 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:14,335 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:14,335 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:24,336 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:24,336 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:24,411 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:24,411 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:24,413 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:24,413 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:24,413 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:24,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:24,414 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:24,414 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:24,487 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:24,487 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:24,489 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:24,489 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:24,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:24,490 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:24,490 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:24,492 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:24,515 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:24,516 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:34,516 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:34,517 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:34,581 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:34,582 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:34,582 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:34,582 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:34,582 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:34,584 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:34,584 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:34,585 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:34,647 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:34,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:34,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:34,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:34,648 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:34,650 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:34,650 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:34,651 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:34,667 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:34,667 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:44,667 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:44,668 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:44,730 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:44,732 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:44,732 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:44,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:44,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:44,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:44,733 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:44,733 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:44,801 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:44,801 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:44,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:44,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:44,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:44,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:44,803 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:44,803 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:44,819 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:44,821 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:36:54,822 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:36:54,822 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:36:54,888 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:36:54,890 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:54,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:54,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:36:54,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:54,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:54,891 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:36:54,892 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:36:54,957 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:36:54,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:54,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:54,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:36:54,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:36:54,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:36:54,960 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:36:54,961 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:36:54,979 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:36:54,979 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:04,980 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:04,980 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:05,045 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:05,045 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:05,046 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:05,046 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:05,046 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:05,046 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:05,048 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:05,048 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:05,117 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:05,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:05,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:05,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:05,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:05,119 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:05,121 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:05,121 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:05,141 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:05,141 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:15,142 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:15,142 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:15,207 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:15,207 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:15,209 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:15,209 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:15,209 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:15,210 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:15,210 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:15,210 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:15,279 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:15,279 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:15,280 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:15,280 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:15,282 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:15,282 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:15,282 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:15,282 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:15,299 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:15,301 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:25,302 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:25,302 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:25,369 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:25,369 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:25,371 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:25,371 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:25,371 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:25,371 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:25,371 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:25,372 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:25,443 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:25,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:25,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:25,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:25,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:25,444 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:25,446 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:25,447 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:25,463 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:25,463 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:35,464 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:35,466 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:35,532 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:35,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:35,533 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:35,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:35,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:35,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:35,536 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:35,536 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:35,601 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:35,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:35,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:35,602 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:35,604 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:35,604 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:35,605 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:35,605 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:35,621 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:35,621 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:45,622 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:45,624 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:45,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:45,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:45,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:45,688 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:45,688 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:45,690 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:45,690 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:45,690 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:45,757 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:45,757 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:45,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:45,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:45,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:45,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:45,760 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:45,762 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:45,779 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:45,780 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:37:55,782 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:37:55,782 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:37:55,842 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:37:55,844 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:55,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:55,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:37:55,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:55,845 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:55,846 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:37:55,846 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:37:55,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:37:55,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:55,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:55,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:37:55,923 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:37:55,923 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:37:55,924 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:37:55,924 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:37:55,940 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:37:55,941 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:05,941 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:05,943 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:06,028 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:06,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:06,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:06,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:06,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:06,030 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:06,032 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:06,032 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:06,098 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:06,099 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:06,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:06,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:06,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:06,101 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:06,101 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:06,102 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:06,118 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:06,119 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:16,119 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:16,121 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:16,184 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:16,184 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:16,186 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:16,187 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:16,187 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:16,187 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:16,187 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:16,187 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:16,252 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:16,252 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:16,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:16,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:16,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:16,253 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:16,255 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:16,255 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:16,269 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:16,270 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:26,272 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:26,273 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:26,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:26,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:26,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:26,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:26,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:26,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:26,348 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:26,348 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:26,417 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:26,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:26,418 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:26,420 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:26,420 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:26,421 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:26,421 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:26,421 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:26,438 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:26,440 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:36,440 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:36,441 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:36,517 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:36,519 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:36,519 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:36,519 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:36,520 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:36,520 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:36,522 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:36,522 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:36,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:36,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:36,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:36,608 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:36,609 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:36,609 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:36,611 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:36,611 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:36,628 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:36,628 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:46,630 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:46,631 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:46,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:46,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:46,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:46,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:46,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:46,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:46,696 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:46,697 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:46,759 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:46,760 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:46,760 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:46,762 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:46,762 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:46,763 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:46,763 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:46,763 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:46,780 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:46,782 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:38:56,782 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:38:56,782 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:38:56,851 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:38:56,851 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:56,851 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:56,852 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:38:56,852 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:56,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:56,854 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:38:56,855 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:38:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:38:56,921 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:56,923 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:56,923 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:38:56,923 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:38:56,924 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:38:56,924 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:38:56,924 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:38:56,940 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:38:56,941 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:06,943 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:06,944 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:07,009 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:07,010 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:07,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:07,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:07,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:07,013 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:07,013 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:07,081 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:07,081 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:07,082 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:07,082 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:07,082 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:07,082 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:07,082 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:07,084 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:07,101 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:07,102 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:17,104 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:17,104 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:17,167 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:17,168 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:17,170 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:17,170 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:17,170 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:17,171 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:17,171 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:17,171 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:17,236 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:17,237 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:17,239 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:17,239 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:17,239 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:17,240 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:17,240 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:17,240 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:17,256 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:17,256 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:27,257 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:27,257 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:27,332 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:27,332 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:27,334 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:27,334 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:27,335 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:27,335 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:27,335 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:27,335 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:27,404 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:27,405 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:27,405 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:27,407 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:27,407 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:27,407 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:27,407 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:27,408 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:27,426 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:27,426 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:37,427 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:37,427 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:37,494 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:37,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:37,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:37,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:37,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:37,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:37,497 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:37,499 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:37,561 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:37,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:37,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:37,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:37,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:37,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:37,563 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:37,565 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:37,582 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:37,584 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:47,585 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:47,585 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:47,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:47,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:47,663 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:47,663 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:47,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:47,664 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:47,664 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:47,664 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:47,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:47,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:47,733 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:47,734 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:47,734 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:47,736 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:47,736 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:47,736 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:47,755 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:47,756 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:39:57,756 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:39:57,756 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:39:57,832 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:39:57,834 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:57,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:57,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:39:57,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:57,835 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:57,835 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:39:57,836 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:39:57,900 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:39:57,900 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:57,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:57,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:39:57,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:39:57,901 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:39:57,903 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:39:57,903 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:39:57,918 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:39:57,920 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:40:07,921 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:40:07,921 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:40:07,989 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:40:07,989 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:40:07,990 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:40:07,990 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:40:07,990 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:40:07,990 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:40:07,990 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:40:07,992 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:40:08,084 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:40:08,085 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:40:08,085 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:40:08,085 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:40:08,085 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:40:08,086 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 1.0 2021-11-21 23:40:08,086 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 1.00 and expected value: 0.99 2021-11-21 23:40:08,088 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:40:08,107 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:40:08,108 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:40:18,128 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:40:18,130 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637566818.13 2021-11-21 23:40:18,130 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637566818.13' started 2021-11-21 23:40:18,131 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637566818.13 2021-11-21 23:40:18,273 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637566818.23 2021-11-21 23:40:18,273 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'PrintBucketStats_default_1637566818.23' started 2021-11-21 23:40:18,273 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:40:18,273 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22' started 2021-11-21 23:40:18,275 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:40:18,275 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' started 2021-11-21 23:40:18,275 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:40:18,276 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' started 2021-11-21 23:40:18,279 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:40:18,279 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22' started 2021-11-21 23:40:18,280 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:40:18,280 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' started 2021-11-21 23:40:18,280 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:40:18,280 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22' started 2021-11-21 23:40:18,285 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:40:18,286 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:40:18,286 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' started 2021-11-21 23:40:18,286 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:40:18,286 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22' started 2021-11-21 23:40:18,288 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:40:18,285 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22' started 2021-11-21 23:40:18,289 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:40:18,292 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' started 2021-11-21 23:40:18,292 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22' started 2021-11-21 23:40:18,292 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:40:18,293 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' started 2021-11-21 23:40:18,293 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:40:18,296 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22' started 2021-11-21 23:40:18,296 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:40:18,296 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22' started 2021-11-21 23:40:18,299 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' started 2021-11-21 23:40:18,299 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:40:18,305 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:40:18,305 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:40:18,305 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:40:18,306 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' started 2021-11-21 23:40:18,306 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:40:18,306 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22' started 2021-11-21 23:40:18,306 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22' started 2021-11-21 23:40:18,306 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' started 2021-11-21 23:40:18,309 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:40:18,309 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22' started 2021-11-21 23:40:18,315 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:40:18,316 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' started 2021-11-21 23:40:18,318 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22' started 2021-11-21 23:40:18,316 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:40:18,322 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:40:18,322 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' started 2021-11-21 23:40:18,323 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22' started 2021-11-21 23:40:18,323 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:40:18,325 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:40:18,325 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22' started 2021-11-21 23:40:18,325 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:40:18,325 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' started 2021-11-21 23:40:18,326 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:40:18,328 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:40:18,328 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22' started 2021-11-21 23:40:18,328 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22' started 2021-11-21 23:40:18,328 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:40:18,329 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:40:18,329 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:40:18,331 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:40:18,332 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:40:18,332 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:40:18,332 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:40:18,332 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:40:18,334 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:40:18,335 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:40:18,335 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:40:18,335 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:40:18,336 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:40:18,336 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:40:18,338 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:40:18,338 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:40:18,338 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:40:18,341 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:40:18,342 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:40:18,342 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:40:18,342 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:40:18,342 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:40:18,344 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:40:18,345 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:40:18,345 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:40:18,345 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22 2021-11-21 23:40:18,345 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:40:18,346 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:40:18,346 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:40:18,348 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23 2021-11-21 23:40:18,348 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:40:18,348 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:40:18,349 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:40:18,349 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23 2021-11-21 23:40:18,349 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:40:18,351 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:40:18,351 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:40:18,351 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23 2021-11-21 23:40:18,352 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:40:18,352 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:40:18,354 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:40:18,354 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:40:18,355 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23 2021-11-21 23:40:18,355 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:40:18,355 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:40:18,357 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:40:18,357 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:40:18,358 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:40:18,358 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:40:18,358 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:40:18,359 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:40:18,361 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:40:18,361 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:40:18,747 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:40:18,756 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:18,756 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:20,269 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:40:20,275 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:20,276 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:21,749 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 643.200000 2021-11-21 23:40:21,756 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:21,756 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:23,203 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 643.200000 2021-11-21 23:40:23,209 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:23,209 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:24,686 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 1857.300000 2021-11-21 23:40:24,690 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:24,691 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:26,190 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 1857.300000 2021-11-21 23:40:26,196 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:26,197 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:27,625 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 1857.300000 2021-11-21 23:40:27,631 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:27,631 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:29,141 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 1857.300000 2021-11-21 23:40:29,148 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:29,148 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:30,605 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 1857.300000 2021-11-21 23:40:30,611 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:30,611 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:32,108 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3665.400000 2021-11-21 23:40:32,117 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:32,117 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:33,661 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:33,667 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:33,667 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:35,147 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:35,155 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:35,157 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:36,663 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:36,667 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:36,667 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:38,173 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:38,180 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:38,180 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:39,640 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:39,645 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:39,647 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:41,121 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4799.000000 2021-11-21 23:40:41,125 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:41,127 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:42,625 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4618.800000 2021-11-21 23:40:42,634 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:42,635 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:44,147 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4476.600000 2021-11-21 23:40:44,153 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:44,154 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:45,644 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4476.600000 2021-11-21 23:40:45,651 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:45,651 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:47,118 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4476.600000 2021-11-21 23:40:47,125 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:47,125 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:48,628 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4476.600000 2021-11-21 23:40:48,634 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:48,635 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:50,107 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4476.600000 2021-11-21 23:40:50,111 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:50,111 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:51,618 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.600000 2021-11-21 23:40:51,625 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:51,625 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:53,153 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.600000 2021-11-21 23:40:53,157 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:53,158 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:54,650 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.200000 2021-11-21 23:40:54,655 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:54,657 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:56,190 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.200000 2021-11-21 23:40:56,196 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:56,196 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:57,654 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.200000 2021-11-21 23:40:57,660 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:57,661 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:40:59,167 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.200000 2021-11-21 23:40:59,173 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:40:59,173 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:00,628 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4630.200000 2021-11-21 23:41:00,634 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:00,634 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:02,111 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4418.000000 2021-11-21 23:41:02,118 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:02,118 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:03,588 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:03,595 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:03,596 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:05,069 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:05,073 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:05,075 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:06,575 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:06,581 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:06,582 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:08,063 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:08,069 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:08,069 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:09,479 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:09,484 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:09,486 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:10,956 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4071.200000 2021-11-21 23:41:10,961 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:10,963 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:12,369 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3940.600000 2021-11-21 23:41:12,375 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:12,375 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:13,887 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:13,891 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:13,891 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:15,319 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:15,325 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:15,325 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:16,868 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:16,874 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:16,874 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:18,308 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:18,312 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:18,313 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:19,786 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:19,790 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:19,790 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:21,213 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4089.000000 2021-11-21 23:41:21,220 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:21,220 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:22,641 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4359.500000 2021-11-21 23:41:22,647 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:22,648 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:24,138 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4451.700000 2021-11-21 23:41:24,144 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:24,144 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:25,615 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4451.700000 2021-11-21 23:41:25,621 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:25,621 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:27,132 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4451.700000 2021-11-21 23:41:27,138 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:27,140 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:28,678 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4451.700000 2021-11-21 23:41:28,684 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:28,684 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:30,138 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4451.700000 2021-11-21 23:41:30,144 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:30,144 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:31,592 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4401.000000 2021-11-21 23:41:31,598 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:31,598 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:33,072 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4401.000000 2021-11-21 23:41:33,078 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:33,078 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:34,516 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4409.600000 2021-11-21 23:41:34,523 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:34,523 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:35,992 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4409.600000 2021-11-21 23:41:35,997 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:35,999 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:37,512 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4409.600000 2021-11-21 23:41:37,517 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:37,517 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:38,979 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4409.600000 2021-11-21 23:41:38,984 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:38,984 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:40,473 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4409.600000 2021-11-21 23:41:40,480 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:40,480 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:41,944 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4442.800000 2021-11-21 23:41:41,948 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:41,950 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:43,384 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4442.800000 2021-11-21 23:41:43,388 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:43,390 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:44,792 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4430.900000 2021-11-21 23:41:44,799 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:44,799 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:46,267 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4430.900000 2021-11-21 23:41:46,275 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:46,275 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:47,720 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4430.900000 2021-11-21 23:41:47,726 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:47,726 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:49,183 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4430.900000 2021-11-21 23:41:49,187 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:49,188 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:50,615 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4430.900000 2021-11-21 23:41:50,619 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:50,621 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:52,105 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.500000 2021-11-21 23:41:52,109 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:52,111 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:53,582 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:41:53,586 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:53,586 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:55,085 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:41:55,091 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:55,092 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:56,589 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:41:56,596 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:56,596 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:58,059 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:41:58,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:58,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:41:59,582 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:41:59,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:41:59,589 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:01,076 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4651.900000 2021-11-21 23:42:01,082 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:01,084 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:02,559 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4541.900000 2021-11-21 23:42:02,565 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:02,565 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:04,088 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.100000 2021-11-21 23:42:04,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:04,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:05,549 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.100000 2021-11-21 23:42:05,558 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:05,559 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:07,095 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.100000 2021-11-21 23:42:07,102 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:07,105 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:08,576 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.100000 2021-11-21 23:42:08,584 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:08,585 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:10,088 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.100000 2021-11-21 23:42:10,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:10,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:11,611 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4220.400000 2021-11-21 23:42:11,617 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:11,618 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:13,137 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4220.400000 2021-11-21 23:42:13,141 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:13,141 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:14,611 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4350.300000 2021-11-21 23:42:14,617 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:14,617 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:16,216 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4350.300000 2021-11-21 23:42:16,221 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:16,221 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:17,736 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4350.300000 2021-11-21 23:42:17,742 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:17,743 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:19,250 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4350.300000 2021-11-21 23:42:19,256 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:19,257 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:20,799 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4350.300000 2021-11-21 23:42:20,809 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:20,809 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:22,289 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4433.700000 2021-11-21 23:42:22,295 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:22,296 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:22,936 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' completed 2021-11-21 23:42:22,937 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22' started 2021-11-21 23:42:23,414 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' completed 2021-11-21 23:42:23,414 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' started 2021-11-21 23:42:23,447 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22' completed 2021-11-21 23:42:23,448 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22' started 2021-11-21 23:42:23,470 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' completed 2021-11-21 23:42:23,470 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22' started 2021-11-21 23:42:23,617 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22' completed 2021-11-21 23:42:23,618 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22' started 2021-11-21 23:42:23,630 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22' completed 2021-11-21 23:42:23,631 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22' started 2021-11-21 23:42:23,729 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22' completed 2021-11-21 23:42:23,730 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' started 2021-11-21 23:42:23,753 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' completed 2021-11-21 23:42:23,753 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22' started 2021-11-21 23:42:23,756 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22' completed 2021-11-21 23:42:23,756 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22' started 2021-11-21 23:42:23,802 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22' completed 2021-11-21 23:42:23,802 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22' started 2021-11-21 23:42:23,838 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22' completed 2021-11-21 23:42:23,838 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' started 2021-11-21 23:42:23,857 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4466.900000 2021-11-21 23:42:23,862 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:23,862 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:23,892 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' completed 2021-11-21 23:42:23,894 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22' started 2021-11-21 23:42:23,895 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' completed 2021-11-21 23:42:23,897 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22' started 2021-11-21 23:42:23,907 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' completed 2021-11-21 23:42:23,907 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22' started 2021-11-21 23:42:23,992 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' completed 2021-11-21 23:42:23,993 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' started 2021-11-21 23:42:24,086 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22' completed 2021-11-21 23:42:24,088 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22' started 2021-11-21 23:42:24,088 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22 are 20000 2021-11-21 23:42:24,088 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1400000 to 1420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,089 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,095 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22' completed 2021-11-21 23:42:24,096 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22' started 2021-11-21 23:42:24,104 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' completed 2021-11-21 23:42:24,105 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22' started 2021-11-21 23:42:24,105 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 are 20000 2021-11-21 23:42:24,107 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1400000 to 1420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,107 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,161 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22' completed 2021-11-21 23:42:24,161 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22' started 2021-11-21 23:42:24,187 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22' completed 2021-11-21 23:42:24,187 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22' completed 2021-11-21 23:42:24,188 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22' started 2021-11-21 23:42:24,187 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' started 2021-11-21 23:42:24,275 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' completed 2021-11-21 23:42:24,276 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22' started 2021-11-21 23:42:24,276 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 are 20000 2021-11-21 23:42:24,276 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1420000 to 1440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,278 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,279 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22 are 20000 2021-11-21 23:42:24,279 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1420000 to 1440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,279 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,280 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 are 20000 2021-11-21 23:42:24,282 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1440000 to 1460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,282 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,364 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22' completed 2021-11-21 23:42:24,365 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22' started 2021-11-21 23:42:24,390 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' completed 2021-11-21 23:42:24,391 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' started 2021-11-21 23:42:24,581 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22' completed 2021-11-21 23:42:24,582 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22' started 2021-11-21 23:42:24,602 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' completed 2021-11-21 23:42:24,604 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22' started 2021-11-21 23:42:24,825 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22' completed 2021-11-21 23:42:24,826 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22' started 2021-11-21 23:42:24,828 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22' completed 2021-11-21 23:42:24,829 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23' started 2021-11-21 23:42:24,829 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22 are 20000 2021-11-21 23:42:24,832 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1400000 to 1420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,832 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,832 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22 are 20000 2021-11-21 23:42:24,832 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1440000 to 1460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,834 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,835 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 are 20000 2021-11-21 23:42:24,835 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1460000 to 1480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,835 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,836 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22 are 20000 2021-11-21 23:42:24,836 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1420000 to 1440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,838 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,838 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 are 20000 2021-11-21 23:42:24,838 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1480000 to 1500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,838 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,839 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22 are 20000 2021-11-21 23:42:24,839 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1460000 to 1480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,841 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,841 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 are 20000 2021-11-21 23:42:24,842 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1500000 to 1520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,842 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,842 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22 are 20000 2021-11-21 23:42:24,842 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1440000 to 1460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,844 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,844 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22 are 20000 2021-11-21 23:42:24,845 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1480000 to 1500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,845 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,845 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 are 20000 2021-11-21 23:42:24,846 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1400000 to 1420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22 2021-11-21 23:42:24,848 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,848 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22 are 20000 2021-11-21 23:42:24,848 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1500000 to 1520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,848 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:42:24,849 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 are 20000 2021-11-21 23:42:24,849 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1520000 to 1540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:42:24,851 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,851 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22 are 20000 2021-11-21 23:42:24,851 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1460000 to 1480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:42:24,851 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:42:24,852 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 are 20000 2021-11-21 23:42:24,852 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1540000 to 1560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:42:24,854 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:42:24,855 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22 are 20000 2021-11-21 23:42:24,855 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1520000 to 1540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:42:24,855 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,857 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 are 20000 2021-11-21 23:42:24,857 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1420000 to 1440000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22 2021-11-21 23:42:24,858 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,858 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22 are 20000 2021-11-21 23:42:24,858 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1480000 to 1500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:42:24,859 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:42:24,859 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 are 20000 2021-11-21 23:42:24,861 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1560000 to 1580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:42:24,861 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:42:24,861 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22 are 20000 2021-11-21 23:42:24,861 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1540000 to 1560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:42:24,862 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,862 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22 are 20000 2021-11-21 23:42:24,864 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1500000 to 1520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:42:24,864 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,865 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 are 20000 2021-11-21 23:42:24,865 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1440000 to 1460000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22 2021-11-21 23:42:24,865 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:42:24,865 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22 are 20000 2021-11-21 23:42:24,867 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1580000 to 1600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:42:24,867 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:42:24,868 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22 are 20000 2021-11-21 23:42:24,868 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1560000 to 1580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:42:24,868 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:42:25,381 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4466.900000 2021-11-21 23:42:25,388 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:25,388 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:26,950 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4466.900000 2021-11-21 23:42:26,956 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:26,957 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:28,529 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4466.900000 2021-11-21 23:42:28,536 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:28,536 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:30,029 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4466.900000 2021-11-21 23:42:30,036 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:30,036 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:31,506 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4518.300000 2021-11-21 23:42:31,512 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:31,513 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:32,997 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4518.300000 2021-11-21 23:42:33,003 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:33,003 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:34,460 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.400000 2021-11-21 23:42:34,467 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:34,467 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:35,997 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.400000 2021-11-21 23:42:36,003 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:36,003 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:37,474 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.400000 2021-11-21 23:42:37,480 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:37,482 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:38,898 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.400000 2021-11-21 23:42:38,904 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:38,905 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:40,414 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4492.400000 2021-11-21 23:42:40,420 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:40,421 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:41,963 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4440.100000 2021-11-21 23:42:41,970 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:41,970 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:43,424 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4440.100000 2021-11-21 23:42:43,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:43,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:44,987 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4471.200000 2021-11-21 23:42:44,994 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:44,996 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:46,493 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4471.200000 2021-11-21 23:42:46,497 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:46,499 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:47,967 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4471.200000 2021-11-21 23:42:47,974 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:47,974 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:49,483 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4471.200000 2021-11-21 23:42:49,487 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:49,487 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:50,937 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4471.200000 2021-11-21 23:42:50,944 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:50,944 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:52,424 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4521.100000 2021-11-21 23:42:52,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:52,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:53,875 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:42:53,881 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:53,881 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:55,421 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:42:55,427 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:55,428 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:57,000 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:42:57,006 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:57,006 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:58,453 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:42:58,459 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:58,459 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:42:59,944 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:42:59,951 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:42:59,951 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:01,467 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4550.200000 2021-11-21 23:43:01,473 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:01,473 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:02,996 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4497.000000 2021-11-21 23:43:03,002 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:03,003 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:04,578 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4456.200000 2021-11-21 23:43:04,585 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:04,585 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:06,063 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4456.200000 2021-11-21 23:43:06,069 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:06,071 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:07,585 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4456.200000 2021-11-21 23:43:07,592 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:07,592 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:09,051 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4456.200000 2021-11-21 23:43:09,056 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:09,058 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:10,535 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4456.200000 2021-11-21 23:43:10,540 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:10,540 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:12,048 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4487.400000 2021-11-21 23:43:12,055 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:12,055 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:13,546 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:13,552 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:13,552 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:15,088 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:15,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:15,095 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:16,562 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:16,569 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:16,569 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:18,009 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:18,015 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:18,016 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:19,509 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:19,515 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:19,515 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:21,005 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4515.400000 2021-11-21 23:43:21,010 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:21,010 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:22,602 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4567.300000 2021-11-21 23:43:22,611 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:22,611 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:24,108 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:24,115 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:24,115 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:25,605 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:25,612 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:25,612 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:27,065 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:27,071 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:27,072 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:28,551 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:28,556 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:28,556 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:29,971 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:29,977 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:29,979 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:31,519 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4591.000000 2021-11-21 23:43:31,525 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:31,526 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:33,078 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4573.700000 2021-11-21 23:43:33,085 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:33,085 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:34,581 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4634.000000 2021-11-21 23:43:34,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:34,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:36,049 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4634.000000 2021-11-21 23:43:36,055 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:36,055 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:37,522 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4634.000000 2021-11-21 23:43:37,528 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:37,528 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:39,059 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4634.000000 2021-11-21 23:43:39,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:39,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:40,586 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4634.000000 2021-11-21 23:43:40,592 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:40,594 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:42,119 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.000000 2021-11-21 23:43:42,128 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:42,128 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:43,582 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:43,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:43,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:45,019 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:45,025 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:45,025 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:46,446 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:46,450 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:46,451 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:47,927 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:47,931 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:47,931 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:49,414 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:49,420 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:49,421 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:50,953 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4735.700000 2021-11-21 23:43:50,960 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:50,960 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:52,424 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4720.800000 2021-11-21 23:43:52,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:52,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:53,898 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:43:53,904 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:53,904 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:55,322 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:43:55,328 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:55,329 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:56,799 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:43:56,805 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:56,806 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:58,335 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:43:58,342 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:58,342 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:43:59,805 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:43:59,812 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:43:59,813 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:01,315 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.100000 2021-11-21 23:44:01,326 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:01,328 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:02,888 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.400000 2021-11-21 23:44:02,894 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:02,894 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:04,391 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.900000 2021-11-21 23:44:04,395 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:04,397 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:05,918 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.900000 2021-11-21 23:44:05,924 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:05,924 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:07,362 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.900000 2021-11-21 23:44:07,368 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:07,369 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:08,894 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.900000 2021-11-21 23:44:08,900 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:08,901 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:10,417 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.900000 2021-11-21 23:44:10,423 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:10,424 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:11,917 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4691.400000 2021-11-21 23:44:11,923 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:11,923 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:13,424 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4691.400000 2021-11-21 23:44:13,430 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:13,431 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:14,957 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4675.100000 2021-11-21 23:44:14,963 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:14,964 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:16,463 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4675.100000 2021-11-21 23:44:16,467 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:16,469 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:17,983 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4675.100000 2021-11-21 23:44:17,990 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:17,990 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:19,558 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4675.100000 2021-11-21 23:44:19,563 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:19,563 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:21,066 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4675.100000 2021-11-21 23:44:21,075 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:21,075 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:22,582 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4649.400000 2021-11-21 23:44:22,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:22,588 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:24,051 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4527.400000 2021-11-21 23:44:24,056 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:24,056 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:24,535 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' completed 2021-11-21 23:44:24,536 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23' started 2021-11-21 23:44:24,561 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22' completed 2021-11-21 23:44:24,562 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23' started 2021-11-21 23:44:24,680 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22' completed 2021-11-21 23:44:24,680 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' started 2021-11-21 23:44:24,700 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22' completed 2021-11-21 23:44:24,701 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23' started 2021-11-21 23:44:24,701 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22 are 20000 2021-11-21 23:44:24,703 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1520000 to 1540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:44:24,703 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:44:24,704 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 are 20000 2021-11-21 23:44:24,706 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1460000 to 1480000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22 2021-11-21 23:44:24,706 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:44:24,707 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22 are 20000 2021-11-21 23:44:24,707 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1580000 to 1600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:44:24,709 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:24,709 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22 are 20000 2021-11-21 23:44:24,710 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1600000 to 1620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:24,710 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:44:24,793 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22' completed 2021-11-21 23:44:24,795 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23' started 2021-11-21 23:44:24,805 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22' completed 2021-11-21 23:44:24,805 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23' started 2021-11-21 23:44:25,026 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' completed 2021-11-21 23:44:25,028 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23' started 2021-11-21 23:44:25,121 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' completed 2021-11-21 23:44:25,122 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' started 2021-11-21 23:44:25,315 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22' completed 2021-11-21 23:44:25,316 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23' started 2021-11-21 23:44:25,318 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22 are 20000 2021-11-21 23:44:25,319 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1540000 to 1560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:44:25,319 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:25,319 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22 are 20000 2021-11-21 23:44:25,321 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1600000 to 1620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:25,322 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:44:25,490 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22' completed 2021-11-21 23:44:25,492 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23' started 2021-11-21 23:44:25,517 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' completed 2021-11-21 23:44:25,519 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23' started 2021-11-21 23:44:25,519 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 are 20000 2021-11-21 23:44:25,522 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1480000 to 1500000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22 2021-11-21 23:44:25,522 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:25,569 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4527.400000 2021-11-21 23:44:25,573 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:25,573 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:25,648 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' completed 2021-11-21 23:44:25,648 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' started 2021-11-21 23:44:25,805 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' completed 2021-11-21 23:44:25,806 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23' started 2021-11-21 23:44:25,836 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22' completed 2021-11-21 23:44:25,838 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' started 2021-11-21 23:44:25,917 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22' completed 2021-11-21 23:44:25,917 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23' started 2021-11-21 23:44:25,917 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22 are 20000 2021-11-21 23:44:25,918 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1620000 to 1640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:25,920 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:44:26,016 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22' completed 2021-11-21 23:44:26,016 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23' started 2021-11-21 23:44:26,051 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22' completed 2021-11-21 23:44:26,052 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23' started 2021-11-21 23:44:26,052 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22 are 20000 2021-11-21 23:44:26,052 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1560000 to 1580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:44:26,052 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:26,092 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22' completed 2021-11-21 23:44:26,094 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23' started 2021-11-21 23:44:26,197 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22' completed 2021-11-21 23:44:26,197 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23' started 2021-11-21 23:44:26,198 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22 are 20000 2021-11-21 23:44:26,198 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1620000 to 1640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:26,200 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:44:26,200 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 are 20000 2021-11-21 23:44:26,200 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1500000 to 1520000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22 2021-11-21 23:44:26,201 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:26,201 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22 are 20000 2021-11-21 23:44:26,203 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1640000 to 1660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:26,203 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:26,203 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22 are 20000 2021-11-21 23:44:26,204 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1640000 to 1660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:26,206 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:44:26,206 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22 are 20000 2021-11-21 23:44:26,206 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1580000 to 1600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22 2021-11-21 23:44:26,207 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:44:26,207 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 are 20000 2021-11-21 23:44:26,207 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1520000 to 1540000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22 2021-11-21 23:44:26,207 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:44:26,209 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22 are 20000 2021-11-21 23:44:26,209 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1660000 to 1680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:44:26,210 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:26,250 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22' completed 2021-11-21 23:44:26,250 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23' started 2021-11-21 23:44:26,378 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22' completed 2021-11-21 23:44:26,381 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22 are 20000 2021-11-21 23:44:26,381 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' started 2021-11-21 23:44:26,381 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1600000 to 1620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22 2021-11-21 23:44:26,381 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:44:26,426 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22' completed 2021-11-21 23:44:26,427 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' started 2021-11-21 23:44:26,563 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22' completed 2021-11-21 23:44:26,565 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' started 2021-11-21 23:44:26,661 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22' completed 2021-11-21 23:44:26,661 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' started 2021-11-21 23:44:26,661 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22 are 20000 2021-11-21 23:44:26,663 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1660000 to 1680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22 2021-11-21 23:44:26,664 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:44:26,752 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23' completed 2021-11-21 23:44:26,854 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22' completed 2021-11-21 23:44:26,855 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22 are 20000 2021-11-21 23:44:26,855 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1680000 to 1700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:44:26,855 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:44:26,857 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 are 20000 2021-11-21 23:44:26,857 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1540000 to 1560000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22 2021-11-21 23:44:26,858 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:26,858 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22 are 20000 2021-11-21 23:44:26,858 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1620000 to 1640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22 2021-11-21 23:44:26,859 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:44:26,859 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22 are 20000 2021-11-21 23:44:26,861 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1680000 to 1700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22 2021-11-21 23:44:26,861 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:44:26,861 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22 are 20000 2021-11-21 23:44:26,862 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1700000 to 1720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:44:26,862 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:44:26,864 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 are 20000 2021-11-21 23:44:26,864 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1560000 to 1580000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22 2021-11-21 23:44:26,865 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:27,109 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4527.400000 2021-11-21 23:44:27,115 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:27,115 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:27,733 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22' completed 2021-11-21 23:44:27,733 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22 are 20000 2021-11-21 23:44:27,734 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1640000 to 1660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22 2021-11-21 23:44:27,734 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22 2021-11-21 23:44:27,736 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22 are 20000 2021-11-21 23:44:27,736 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1720000 to 1740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22 2021-11-21 23:44:27,736 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:44:28,069 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22' completed 2021-11-21 23:44:28,071 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22 are 20000 2021-11-21 23:44:28,072 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1700000 to 1720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22 2021-11-21 23:44:28,072 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:44:28,072 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23 are 20000 2021-11-21 23:44:28,072 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1660000 to 1680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:44:28,073 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:44:28,625 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4527.400000 2021-11-21 23:44:28,635 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:28,637 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:30,078 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4527.400000 2021-11-21 23:44:30,082 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:30,084 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:31,555 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4369.900000 2021-11-21 23:44:31,559 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:31,561 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:33,051 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4369.900000 2021-11-21 23:44:33,058 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:33,059 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:34,516 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4339.000000 2021-11-21 23:44:34,522 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:34,523 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:36,022 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4339.000000 2021-11-21 23:44:36,026 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:36,026 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:37,520 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4339.000000 2021-11-21 23:44:37,526 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:37,528 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:38,983 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4339.000000 2021-11-21 23:44:38,990 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:38,990 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:40,453 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4339.000000 2021-11-21 23:44:40,460 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:40,460 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:41,963 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.700000 2021-11-21 23:44:41,967 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:41,969 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:43,434 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4270.700000 2021-11-21 23:44:43,440 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:43,441 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:44,990 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4132.900000 2021-11-21 23:44:44,997 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:44,997 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:46,509 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4132.900000 2021-11-21 23:44:46,513 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:46,513 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:48,039 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4132.900000 2021-11-21 23:44:48,043 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:48,045 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:49,530 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4132.900000 2021-11-21 23:44:49,536 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:49,536 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:51,073 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4132.900000 2021-11-21 23:44:51,081 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:51,082 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:52,638 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4125.200000 2021-11-21 23:44:52,645 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:52,645 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:54,121 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:44:54,125 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:54,125 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:55,604 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:44:55,609 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:55,609 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:57,039 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:44:57,046 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:57,046 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:44:58,492 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:44:58,497 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:44:58,497 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:00,015 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:45:00,020 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:00,020 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:01,482 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4186.000000 2021-11-21 23:45:01,486 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:01,487 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:03,059 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4186.000000 2021-11-21 23:45:03,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:03,065 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:04,549 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4351.600000 2021-11-21 23:45:04,556 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:04,558 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:06,042 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4351.600000 2021-11-21 23:45:06,046 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:06,046 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:07,536 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4351.600000 2021-11-21 23:45:07,542 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:07,542 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:09,006 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4351.600000 2021-11-21 23:45:09,013 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:09,015 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:10,459 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4351.600000 2021-11-21 23:45:10,464 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:10,466 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:11,960 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4224.300000 2021-11-21 23:45:11,967 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:11,967 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:13,446 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4224.300000 2021-11-21 23:45:13,450 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:13,451 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:14,908 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4113.100000 2021-11-21 23:45:14,914 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:14,914 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:16,354 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4113.100000 2021-11-21 23:45:16,361 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:16,361 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:17,770 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4113.100000 2021-11-21 23:45:17,776 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:17,778 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:19,229 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4113.100000 2021-11-21 23:45:19,234 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:19,234 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:20,729 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4113.100000 2021-11-21 23:45:20,733 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:20,733 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:22,142 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4149.100000 2021-11-21 23:45:22,148 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:22,148 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:23,619 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:23,625 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:23,625 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:25,111 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:25,117 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:25,118 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:26,572 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:26,578 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:26,578 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:28,069 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:28,072 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:28,073 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:29,516 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:29,520 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:29,520 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:30,928 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4105.300000 2021-11-21 23:45:30,934 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:30,936 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:32,319 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3569.400000 2021-11-21 23:45:32,322 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:32,323 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:33,789 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:33,795 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:33,796 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:35,263 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:35,270 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:35,270 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:36,697 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:36,701 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:36,703 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:38,107 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:38,111 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:38,111 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:39,604 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:39,609 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:39,611 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:41,082 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2980.400000 2021-11-21 23:45:41,092 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:41,094 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:42,630 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3536.100000 2021-11-21 23:45:42,634 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:42,635 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:44,095 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:44,102 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:44,102 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:45,523 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:45,529 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:45,530 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:46,986 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:46,992 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:46,993 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:48,431 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:48,436 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:48,437 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:49,908 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:49,914 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:49,914 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:51,415 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4222.900000 2021-11-21 23:45:51,420 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:51,421 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:52,868 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3822.100000 2021-11-21 23:45:52,874 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:52,875 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:54,286 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3150.800000 2021-11-21 23:45:54,292 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:54,293 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:55,696 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3150.800000 2021-11-21 23:45:55,701 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:55,701 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:57,180 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3150.800000 2021-11-21 23:45:57,186 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:57,186 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:45:58,664 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3150.800000 2021-11-21 23:45:58,668 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:45:58,670 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:00,171 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3150.800000 2021-11-21 23:46:00,177 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:00,177 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:01,657 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2890.200000 2021-11-21 23:46:01,661 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:01,663 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:03,148 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 2890.200000 2021-11-21 23:46:03,155 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:03,157 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:04,612 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3103.800000 2021-11-21 23:46:04,618 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:04,618 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:06,076 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3103.800000 2021-11-21 23:46:06,082 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:06,082 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:07,611 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3103.800000 2021-11-21 23:46:07,617 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:07,618 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:09,068 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3103.800000 2021-11-21 23:46:09,076 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:09,078 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:10,549 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3103.800000 2021-11-21 23:46:10,555 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:10,556 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:12,084 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3403.100000 2021-11-21 23:46:12,091 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:12,092 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:13,615 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:13,619 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:13,619 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:15,105 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:15,109 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:15,109 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:16,704 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:16,710 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:16,710 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:18,217 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:18,223 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:18,224 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:19,697 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:19,701 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:19,701 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:21,219 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3444.200000 2021-11-21 23:46:21,224 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:21,224 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:22,638 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.700000 2021-11-21 23:46:22,644 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:22,644 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:24,209 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.500000 2021-11-21 23:46:24,213 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:24,213 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:25,674 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.500000 2021-11-21 23:46:25,680 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:25,680 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:27,167 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.500000 2021-11-21 23:46:27,174 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:27,174 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:28,348 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23' completed 2021-11-21 23:46:28,624 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.500000 2021-11-21 23:46:28,631 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:28,631 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:29,260 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23' completed 2021-11-21 23:46:29,341 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23' completed 2021-11-21 23:46:29,378 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' completed 2021-11-21 23:46:29,525 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' completed 2021-11-21 23:46:29,684 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23' completed 2021-11-21 23:46:29,773 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' completed 2021-11-21 23:46:29,803 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23' completed 2021-11-21 23:46:29,829 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23' completed 2021-11-21 23:46:30,069 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4066.500000 2021-11-21 23:46:30,075 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:30,076 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:30,196 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23' completed 2021-11-21 23:46:30,316 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' completed 2021-11-21 23:46:30,411 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23' completed 2021-11-21 23:46:30,476 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23' completed 2021-11-21 23:46:30,536 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23' completed 2021-11-21 23:46:30,538 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23 are 20000 2021-11-21 23:46:30,538 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1740000 to 1760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:30,539 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23 2021-11-21 23:46:30,539 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23 are 20000 2021-11-21 23:46:30,539 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1580000 to 1600000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23 2021-11-21 23:46:30,540 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:30,641 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23' completed 2021-11-21 23:46:30,664 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' completed 2021-11-21 23:46:30,665 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 are 20000 2021-11-21 23:46:30,665 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1720000 to 1740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:30,667 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:46:30,667 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23 are 20000 2021-11-21 23:46:30,667 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1680000 to 1700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:46:30,668 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:30,668 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23 are 20000 2021-11-21 23:46:30,670 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1760000 to 1780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:30,670 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23 2021-11-21 23:46:30,671 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23 are 20000 2021-11-21 23:46:30,671 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1600000 to 1620000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23 2021-11-21 23:46:30,671 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:46:30,673 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23 are 20000 2021-11-21 23:46:30,673 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1700000 to 1720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:46:30,673 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:30,730 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' completed 2021-11-21 23:46:30,730 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 are 20000 2021-11-21 23:46:30,732 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1740000 to 1760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:30,732 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:30,832 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23' completed 2021-11-21 23:46:30,832 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23 are 20000 2021-11-21 23:46:30,832 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1780000 to 1800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:30,834 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23 2021-11-21 23:46:30,834 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23 are 20000 2021-11-21 23:46:30,835 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1620000 to 1640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23 2021-11-21 23:46:30,835 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:30,974 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' completed 2021-11-21 23:46:31,013 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23' completed 2021-11-21 23:46:31,111 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23' completed 2021-11-21 23:46:31,112 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23 are 20000 2021-11-21 23:46:31,112 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1720000 to 1740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:31,114 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,114 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 are 20000 2021-11-21 23:46:31,115 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1760000 to 1780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,115 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:31,203 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' completed 2021-11-21 23:46:31,371 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23' completed 2021-11-21 23:46:31,372 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23 are 20000 2021-11-21 23:46:31,372 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1740000 to 1760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:31,374 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,374 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 are 20000 2021-11-21 23:46:31,375 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1780000 to 1800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,375 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23 2021-11-21 23:46:31,375 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23 are 20000 2021-11-21 23:46:31,375 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1640000 to 1660000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23 2021-11-21 23:46:31,377 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,377 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23 are 20000 2021-11-21 23:46:31,378 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1760000 to 1780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,378 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:46:31,378 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23 are 20000 2021-11-21 23:46:31,380 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1660000 to 1680000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23 2021-11-21 23:46:31,380 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,536 | test | DEBUG | pool-3-thread-9 | [task:record_bucket_ops:3570] Ops rate for 'default': 4108.400000 2021-11-21 23:46:31,542 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:31,542 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:31,733 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23' completed 2021-11-21 23:46:31,734 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23 are 20000 2021-11-21 23:46:31,736 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1780000 to 1800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,736 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:46:31,736 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23 are 20000 2021-11-21 23:46:31,736 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1680000 to 1700000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23 2021-11-21 23:46:31,736 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:46:31,737 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23 are 20000 2021-11-21 23:46:31,737 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1700000 to 1720000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23 2021-11-21 23:46:31,739 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:31,739 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 are 20000 2021-11-21 23:46:31,740 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1720000 to 1740000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23 2021-11-21 23:46:31,740 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:31,740 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 are 20000 2021-11-21 23:46:31,740 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1740000 to 1760000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23 2021-11-21 23:46:31,742 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,742 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 are 20000 2021-11-21 23:46:31,743 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1760000 to 1780000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23 2021-11-21 23:46:31,743 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,743 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 are 20000 2021-11-21 23:46:31,743 | test | DEBUG | pool-3-thread-20 | [task:execute_tasks:3915] Failed to load 0 docs from 1780000 to 1800000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23 2021-11-21 23:46:31,744 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637566818.23 2021-11-21 23:46:32,549 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'default' +----------+----------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+----------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **.............**.........................*****......................................*........................*****X | 4799.000 | | 4618.800 | ...............................................................................................X | 4618.800 | | 4476.600 | ............................................................................................*****.**..****X | 4630.200 | | 4418.000 | ...........................................................................................X | 4418.000 | | 4071.200 | ...................................................................................*****X | 4071.200 | | 3940.600 | .................................................................................*...******.....*..****X | 4451.700 | | 4401.000 | ..........................................................................................*******.*X | 4442.800 | | 4430.900 | ...........................................................................................*****..*..*****X | 4651.900 | | 4541.900 | .............................................................................................X | 4541.900 | | 4270.100 | .......................................................................................****X | 4270.100 | | 4220.400 | ......................................................................................**...*****..*.*****.*X | 4518.300 | | 4492.400 | ............................................................................................****X | 4492.400 | | 4440.100 | ...........................................................................................**.*****.******X | 4550.200 | | 4497.000 | ............................................................................................X | 4497.000 | | 4456.200 | ...........................................................................................*****.*.******.******X | 4591.000 | | 4573.700 | ..............................................................................................*.*****..******X | 4735.700 | | 4720.800 | .................................................................................................X | 4720.800 | | 4713.100 | .................................................................................................*******.****X | 4759.900 | | 4691.400 | ................................................................................................*X | 4691.400 | | 4675.100 | ................................................................................................****X | 4675.100 | | 4649.400 | ...............................................................................................X | 4649.400 | | 4527.400 | .............................................................................................****X | 4527.400 | | 4369.900 | ..........................................................................................*X | 4369.900 | | 4339.000 | .........................................................................................****X | 4339.000 | | 4270.700 | .......................................................................................*X | 4270.700 | | 4132.900 | .....................................................................................****X | 4132.900 | | 4125.200 | ....................................................................................X | 4125.200 | | 4090.100 | ....................................................................................*****..**...****X | 4351.600 | | 4224.300 | .......................................................................................*X | 4224.300 | | 4113.100 | ....................................................................................*****.X | 4149.100 | | 4105.300 | ....................................................................................*****X | 4105.300 | | 3569.400 | .........................................................................X | 3569.400 | | 2980.400 | .............................................................******...........*..............*****X | 4222.900 | | 3822.100 | ..............................................................................X | 3822.100 | | 3150.800 | ................................................................****X | 3150.800 | | 2890.200 | ...........................................................**....*****......*.******......*.......*****.X | 4108.400 | +----------+----------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:46:32,551 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637566818.23' completed 2021-11-21 23:46:32,552 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:46:32,552 | infra | WARNING | pool-3-thread-20 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637566818.13' not completed 2021-11-21 23:46:32,552 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:46:32,552 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1400000_1420000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,552 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,553 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,553 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1420000_1440000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,555 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,555 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1400000_1420000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,555 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1440000_1460000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,555 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,556 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1420000_1440000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,556 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,558 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1460000_1480000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,559 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,559 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1440000_1460000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,559 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1480000_1500000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,559 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1400000_1420000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,561 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1500000_1520000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,562 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,562 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1460000_1480000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,562 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,562 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1520000_1540000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,563 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1420000_1440000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,563 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1480000_1500000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,565 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,565 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1540000_1560000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,565 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1500000_1520000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,565 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1440000_1460000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,566 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,566 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1560000_1580000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,568 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1520000_1540000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,568 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1460000_1480000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,569 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1580000_1600000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,569 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,569 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1540000_1560000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,571 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1600000_1620000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,572 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1480000_1500000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,572 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,572 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1560000_1580000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,572 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1620000_1640000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,572 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1500000_1520000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,573 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1640000_1660000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,575 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,575 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1580000_1600000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,576 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1520000_1540000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,578 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1660000_1680000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,578 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1600000_1620000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,578 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,579 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1680000_1700000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,581 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1540000_1560000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,581 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1620000_1640000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,582 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,582 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1700000_1720000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,582 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1560000_1580000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,582 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1640000_1660000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,584 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1720000_1740000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,585 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.22' complete. Loaded 20000 items 2021-11-21 23:46:32,585 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1660000_1680000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,585 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1740000_1760000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,586 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1580000_1600000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,586 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,588 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1680000_1700000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,588 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1760000_1780000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,588 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1600000_1620000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,589 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1700000_1720000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,589 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,591 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1780000_1800000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,592 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1620000_1640000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,592 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1720000_1740000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,592 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,592 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1740000_1760000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,594 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,594 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1640000_1660000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,595 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1760000_1780000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,595 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1660000_1680000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,595 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default__default__default_ttl=0_create_NONE_1780000_1800000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,596 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1680000_1700000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,596 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1700000_1720000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,596 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1720000_1740000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,598 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1740000_1760000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,598 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1760000_1780000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,598 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637566818.13_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1780000_1800000_1637566818.23' complete. Loaded 20000 items 2021-11-21 23:46:32,641 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'PrintBucketStats_default_1637567192.6' started 2021-11-21 23:46:32,641 | infra | INFO | pool-3-thread-20 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637567192.6 2021-11-21 23:46:32,642 | infra | DEBUG | pool-3-thread-20 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637567192.6 2021-11-21 23:46:33,078 | test | DEBUG | pool-3-thread-30 | [task:record_bucket_ops:3570] Ops rate for 'default': 4108.400000 2021-11-21 23:46:33,084 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:46:33,085 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:46:34,086 | test | INFO | pool-3-thread-30 | [table_view:display:72] Ops trend for bucket 'default' +----------+------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+------------------------------------------------------------------------------------------------------+----------+ | 4108.400 | ...................................................................................................X | 4108.400 | +----------+------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:46:34,088 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637567192.6' completed 2021-11-21 23:46:34,088 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:46:34,088 | infra | WARNING | pool-3-thread-20 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637566818.13' not completed 2021-11-21 23:46:34,089 | infra | DEBUG | pool-3-thread-20 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:46:34,089 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637566818.13' completed 2021-11-21 23:46:34,295 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:46:34,312 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:46:34,630 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:46:34,928 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:46:35,072 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:46:35,073 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:46:35,105 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:46:35,138 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:46:35,167 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:46:35,204 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:46:35,233 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:46:35,263 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:46:35,293 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:46:35,295 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637567195.3 2021-11-21 23:46:35,296 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567195.3' started 2021-11-21 23:46:35,298 | infra | DEBUG | pool-3-thread-23 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:46:35,309 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:46:35,790 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:46:36,176 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:46:36,328 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:46:36,331 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:46:36,361 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:46:36,394 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:46:36,426 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:46:36,466 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:46:36,496 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:46:36,523 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:46:36,552 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:46:36,552 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637567196.55 2021-11-21 23:46:36,553 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567196.55' started 2021-11-21 23:46:36,553 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637567195.3 2021-11-21 23:46:36,555 | infra | DEBUG | pool-3-thread-1 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:46:37,915 | test | DEBUG | pool-3-thread-23 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:46:37,917 | test | DEBUG | pool-3-thread-23 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:46:37,917 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567195.3' completed 2021-11-21 23:46:37,920 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:46:37,921 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637567196.55 2021-11-21 23:46:39,078 | test | DEBUG | pool-3-thread-1 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:46:39,078 | test | DEBUG | pool-3-thread-1 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:46:39,078 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567196.55' completed 2021-11-21 23:46:39,081 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:46:39,082 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:642] Added items from 1400000 to 1800000 2021-11-21 23:46:39,082 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:46:39,082 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:46:39,177 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:46:39,178 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:39,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:46:39,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:46:39,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:39,180 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99428 2021-11-21 23:46:39,181 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:46:39,181 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:46:39,255 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:46:39,255 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:39,256 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99739 2021-11-21 23:46:39,256 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:46:39,256 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:39,256 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99653 2021-11-21 23:46:39,257 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:46:39,257 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:46:39,275 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:46:39,275 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:46:49,276 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:46:49,276 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:46:49,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:46:49,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:49,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:46:49,345 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:46:49,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:49,346 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99287 2021-11-21 23:46:49,348 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:46:49,348 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:46:49,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:46:49,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:49,414 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99715 2021-11-21 23:46:49,415 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:46:49,415 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:49,415 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99653 2021-11-21 23:46:49,417 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:46:49,417 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:46:49,434 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:46:49,436 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:46:59,437 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:46:59,437 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:46:59,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:46:59,496 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:59,497 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:46:59,497 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:46:59,499 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:59,500 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99072 2021-11-21 23:46:59,500 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:46:59,500 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:46:59,562 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:46:59,563 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:59,563 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99673 2021-11-21 23:46:59,565 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:46:59,565 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:46:59,565 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99515 2021-11-21 23:46:59,565 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:46:59,565 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:46:59,584 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:46:59,584 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:47:09,585 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:47:09,585 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:47:09,658 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:47:09,660 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:09,660 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:47:09,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:47:09,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:09,661 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98829 2021-11-21 23:47:09,661 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:47:09,661 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:47:09,726 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:47:09,726 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:09,726 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99622 2021-11-21 23:47:09,727 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:47:09,727 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:09,729 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99464 2021-11-21 23:47:09,729 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:47:09,730 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:47:09,746 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:47:09,746 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:47:19,747 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:47:19,749 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:47:19,822 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:47:19,822 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:19,822 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:47:19,822 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:47:19,823 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:19,823 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98696 2021-11-21 23:47:19,825 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:47:19,825 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:47:19,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:47:19,891 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:19,892 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:47:19,892 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:47:19,894 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:19,894 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:47:19,894 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:47:19,894 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:47:19,911 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:47:19,913 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:47:29,914 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:47:29,914 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:47:29,982 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:47:29,982 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:29,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:47:29,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:47:29,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:29,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.9853 2021-11-21 23:47:29,984 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:47:29,984 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:47:30,053 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:47:30,055 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:30,055 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:47:30,055 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:47:30,055 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:30,056 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:47:30,056 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:47:30,058 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:47:30,075 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:47:30,075 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:47:40,076 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:47:40,078 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:47:40,141 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:47:40,142 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:40,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:47:40,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:47:40,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:40,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98399 2021-11-21 23:47:40,145 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:47:40,145 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:47:40,217 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:47:40,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:40,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:47:40,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:47:40,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:40,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:47:40,220 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:47:40,220 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:47:40,239 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:47:40,240 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:47:50,240 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:47:50,242 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:47:50,313 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:47:50,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:50,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.995 2021-11-21 23:47:50,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:47:50,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:50,316 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98279 2021-11-21 23:47:50,318 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:47:50,319 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:47:50,388 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:47:50,390 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:50,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:47:50,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:47:50,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:47:50,391 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:47:50,392 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:47:50,392 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:47:50,411 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:47:50,411 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:00,413 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:00,413 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:00,474 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:00,474 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:00,476 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99472 2021-11-21 23:48:00,476 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:00,476 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:00,476 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:00,477 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:00,477 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:00,551 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:00,551 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:00,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:00,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:00,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:00,552 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:00,553 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:00,553 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:00,571 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:00,572 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:10,572 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:10,573 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:10,638 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:10,640 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:10,641 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99332 2021-11-21 23:48:10,641 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:10,641 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:10,641 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:10,641 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:10,642 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:10,710 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:10,710 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:10,711 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:10,711 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:10,713 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:10,713 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:10,713 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:10,713 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:10,730 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:10,730 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:20,732 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:20,733 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:20,825 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:20,825 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:20,826 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99285 2021-11-21 23:48:20,826 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:20,826 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:20,828 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:20,828 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:20,828 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:20,894 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:20,895 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:20,895 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:20,897 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:20,897 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:20,898 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:20,898 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:20,898 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:20,914 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:20,914 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:30,915 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:30,917 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:30,983 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:30,984 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:30,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99179 2021-11-21 23:48:30,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:30,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:30,986 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:30,987 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:30,987 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:31,051 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:31,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:31,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:31,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:31,052 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:31,053 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:31,053 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:31,053 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:31,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:31,072 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:41,073 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:41,075 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:41,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:41,144 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:41,145 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.9913 2021-11-21 23:48:41,145 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:41,147 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:41,147 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:41,148 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:41,148 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:41,217 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:41,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:41,219 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:41,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:41,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:41,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:41,220 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:41,221 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:41,239 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:41,239 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:48:51,240 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:48:51,240 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:48:51,306 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:48:51,308 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:51,309 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99067 2021-11-21 23:48:51,309 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:48:51,309 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:51,309 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:48:51,309 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:48:51,311 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:48:51,377 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:48:51,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:51,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:48:51,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:48:51,378 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:48:51,380 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:48:51,380 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:48:51,381 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:48:51,397 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:48:51,398 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:01,398 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:01,398 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:01,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:01,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:01,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99001 2021-11-21 23:49:01,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:01,470 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:01,470 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:01,470 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:01,470 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:01,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:01,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:01,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:01,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:01,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:01,539 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:01,539 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:01,539 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:01,556 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:01,558 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:11,558 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:11,559 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:11,631 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:11,631 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:11,631 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98948 2021-11-21 23:49:11,632 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:11,632 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:11,634 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:11,634 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:11,634 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:11,700 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:11,701 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:11,701 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:11,703 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:11,703 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:11,703 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:11,704 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:11,704 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:11,724 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:11,726 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:21,726 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:21,727 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:21,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:21,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:21,802 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98874 2021-11-21 23:49:21,803 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:21,803 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:21,803 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:21,805 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:21,805 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:21,868 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:21,868 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:21,868 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:21,869 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:21,869 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:21,871 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:21,871 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:21,871 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:21,888 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:21,888 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:31,890 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:31,891 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:31,956 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:31,957 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:31,957 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.9878 2021-11-21 23:49:31,957 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:31,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:31,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:31,960 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:31,960 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:32,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:32,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:32,026 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:32,028 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:32,028 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:32,029 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:32,029 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:32,029 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:32,046 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:32,048 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:42,049 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:42,049 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:42,115 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:42,117 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:42,117 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98736 2021-11-21 23:49:42,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:42,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:42,118 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:42,118 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:42,119 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:42,201 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:42,201 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:42,203 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:42,203 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:42,203 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:42,203 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:42,204 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:42,204 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:42,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:42,223 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:49:52,224 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:49:52,226 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:49:52,295 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:49:52,296 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:52,296 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:49:52,296 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:49:52,298 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:52,298 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:49:52,299 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:49:52,299 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:49:52,361 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:49:52,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:52,362 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:49:52,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:49:52,364 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:49:52,365 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:49:52,365 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:49:52,365 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:49:52,381 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:49:52,381 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:02,382 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:02,382 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:02,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:02,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:02,460 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:02,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:02,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:02,461 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:02,463 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:02,463 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:02,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:02,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:02,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:02,539 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:02,539 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:02,539 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:02,539 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:02,540 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:02,556 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:02,558 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:12,559 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:12,559 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:12,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:12,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:12,625 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:12,627 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:12,627 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:12,628 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:12,628 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:12,628 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:12,693 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:12,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:12,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:12,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:12,694 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:12,696 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:12,696 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:12,697 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:12,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:12,714 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:22,716 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:22,717 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:22,789 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:22,790 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:22,792 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:22,792 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:22,792 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:22,792 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:22,792 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:22,793 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:22,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:22,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:22,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:22,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:22,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:22,857 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:22,857 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:22,858 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:22,875 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:22,875 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:32,878 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:32,878 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:32,941 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:32,943 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:32,943 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:32,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:32,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:32,944 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:32,944 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:32,946 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:33,010 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:33,010 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:33,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:33,012 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:33,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:33,013 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:33,013 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:33,013 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:33,030 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:33,032 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:43,032 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:43,032 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:43,153 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:43,153 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:43,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:43,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:43,154 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:43,155 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:43,155 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:43,157 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:43,220 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:43,221 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:43,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:43,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:43,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:43,223 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:43,223 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:43,224 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:43,242 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:43,242 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:50:53,243 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:50:53,243 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:50:53,312 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:50:53,312 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:53,312 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:50:53,313 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:50:53,313 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:53,315 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:50:53,315 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:50:53,315 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:50:53,381 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:50:53,381 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:53,381 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:50:53,381 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:50:53,382 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:50:53,382 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:50:53,382 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:50:53,384 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:50:53,401 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:50:53,401 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:51:03,403 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:51:03,403 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:51:03,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:51:03,467 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:03,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:51:03,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:51:03,469 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:03,470 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:51:03,470 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:51:03,470 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:51:03,535 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:51:03,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:03,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:51:03,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:51:03,536 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:03,538 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:51:03,538 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:51:03,539 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:51:03,555 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:51:03,555 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:51:13,555 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:51:13,556 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:51:13,619 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:51:13,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:13,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:51:13,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:51:13,621 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:13,622 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:51:13,622 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:51:13,624 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:51:13,686 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:51:13,686 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:13,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:51:13,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:51:13,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:13,687 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:51:13,688 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:51:13,688 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:51:13,704 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:51:13,704 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:51:23,706 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:51:23,707 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:51:23,770 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:51:23,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:23,772 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:51:23,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:51:23,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:23,773 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:51:23,773 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:51:23,775 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:51:23,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:51:23,854 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:23,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:51:23,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:51:23,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:23,855 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:51:23,857 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:51:23,857 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:51:23,875 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:51:23,875 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:51:33,875 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:51:33,877 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:51:33,957 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:51:33,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:33,959 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98676 2021-11-21 23:51:33,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:51:33,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:33,960 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.98171 2021-11-21 23:51:33,960 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:51:33,960 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:51:34,039 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:51:34,039 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:34,040 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99593 2021-11-21 23:51:34,040 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:51:34,042 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:51:34,042 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.99452 2021-11-21 23:51:34,042 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.99 and expected value: 0.99 2021-11-21 23:51:34,042 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:51:34,059 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/storage/plasma/plasma_base.py -> validate_plasma_stat_field_value():L187 2021-11-21 23:51:34,061 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: waiting to settle down the plasma stat value 2021-11-21 23:51:44,088 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:51:44,089 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637567504.09 2021-11-21 23:51:44,089 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637567504.09' started 2021-11-21 23:51:44,091 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637567504.09 2021-11-21 23:51:44,267 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637567504.21 2021-11-21 23:51:44,269 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:51:44,269 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19' started 2021-11-21 23:51:44,269 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'PrintBucketStats_default_1637567504.21' started 2021-11-21 23:51:44,269 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:51:44,270 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19' started 2021-11-21 23:51:44,273 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:51:44,276 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:51:44,273 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19' started 2021-11-21 23:51:44,279 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:51:44,280 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19' started 2021-11-21 23:51:44,279 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19' started 2021-11-21 23:51:44,280 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:51:44,282 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:51:44,282 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19' started 2021-11-21 23:51:44,282 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19' started 2021-11-21 23:51:44,283 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19' started 2021-11-21 23:51:44,282 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:51:44,285 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19' started 2021-11-21 23:51:44,285 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:51:44,292 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:51:44,293 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19' started 2021-11-21 23:51:44,293 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:51:44,295 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19' started 2021-11-21 23:51:44,296 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19 2021-11-21 23:51:44,296 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19' started 2021-11-21 23:51:44,302 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:51:44,305 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19 2021-11-21 23:51:44,306 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:51:44,306 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:51:44,308 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:51:44,308 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:51:44,303 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19' started 2021-11-21 23:51:44,309 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:51:44,309 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:51:44,312 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:51:44,312 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2' started 2021-11-21 23:51:44,313 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2' started 2021-11-21 23:51:44,312 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19' started 2021-11-21 23:51:44,313 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2' started 2021-11-21 23:51:44,313 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:51:44,315 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2' started 2021-11-21 23:51:44,315 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2' started 2021-11-21 23:51:44,315 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:51:44,315 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:51:44,321 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2' started 2021-11-21 23:51:44,322 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2' started 2021-11-21 23:51:44,322 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2' started 2021-11-21 23:51:44,321 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2' started 2021-11-21 23:51:44,321 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2' started 2021-11-21 23:51:44,322 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2' started 2021-11-21 23:51:44,322 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:51:44,329 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:51:44,329 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2 2021-11-21 23:51:44,329 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2' started 2021-11-21 23:51:44,331 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:51:44,331 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2 2021-11-21 23:51:44,332 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:51:44,331 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2' started 2021-11-21 23:51:44,332 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:51:44,334 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2' started 2021-11-21 23:51:44,334 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2 2021-11-21 23:51:44,335 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:51:44,336 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:51:44,338 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2 2021-11-21 23:51:44,338 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:51:44,338 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:51:44,339 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2 2021-11-21 23:51:44,339 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:51:44,342 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:51:44,342 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:51:44,342 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:51:44,344 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:51:44,344 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:51:44,345 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:51:44,345 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:51:44,345 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:51:44,346 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:51:44,346 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:51:44,348 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:51:44,348 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:51:44,348 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:51:44,348 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:51:44,349 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:51:44,349 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:51:44,351 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:51:44,351 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:51:44,351 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:51:44,352 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:51:44,352 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:51:44,354 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:51:44,355 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21 2021-11-21 23:51:44,355 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21 2021-11-21 23:51:44,355 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21 2021-11-21 23:51:44,357 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21 2021-11-21 23:51:44,357 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21 2021-11-21 23:51:44,358 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21 2021-11-21 23:51:44,358 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21 2021-11-21 23:51:44,359 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21 2021-11-21 23:51:44,359 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21 2021-11-21 23:51:44,361 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21 2021-11-21 23:51:44,361 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21 2021-11-21 23:51:44,361 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21 2021-11-21 23:51:44,361 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21 2021-11-21 23:51:44,362 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21 2021-11-21 23:51:44,364 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21 2021-11-21 23:51:44,364 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21 2021-11-21 23:51:44,365 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21 2021-11-21 23:51:44,365 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21 2021-11-21 23:51:44,365 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21 2021-11-21 23:51:44,367 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:51:44,743 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:51:44,750 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:44,753 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:46,220 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:51:46,227 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:46,229 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:47,711 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:51:47,719 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:47,719 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:49,170 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:51:49,176 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:49,176 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:50,631 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 0.000000 2021-11-21 23:51:50,638 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:50,638 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:52,088 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 1673.300000 2021-11-21 23:51:52,094 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:52,095 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:53,549 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:51:53,553 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:53,555 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:55,022 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:51:55,028 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:55,029 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:56,487 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:51:56,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:56,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:57,918 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:51:57,924 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:57,924 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:51:59,430 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:51:59,436 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:51:59,437 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:00,869 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3749.600000 2021-11-21 23:52:00,878 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:00,878 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:02,368 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4397.700000 2021-11-21 23:52:02,375 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:02,375 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:03,845 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:03,851 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:03,851 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:05,289 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:05,293 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:05,295 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:06,802 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:06,808 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:06,809 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:08,309 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:08,315 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:08,315 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:09,845 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:09,851 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:09,854 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:11,322 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4703.800000 2021-11-21 23:52:11,326 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:11,328 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:12,757 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4783.400000 2021-11-21 23:52:12,765 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:12,765 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:14,249 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4761.900000 2021-11-21 23:52:14,256 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:14,257 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:15,667 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4761.900000 2021-11-21 23:52:15,674 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:15,674 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:17,135 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4761.900000 2021-11-21 23:52:17,142 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:17,144 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:18,654 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4761.900000 2021-11-21 23:52:18,661 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:18,661 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:20,078 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4761.900000 2021-11-21 23:52:20,085 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:20,085 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:21,604 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4726.000000 2021-11-21 23:52:21,609 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:21,611 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:23,026 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4726.000000 2021-11-21 23:52:23,032 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:23,032 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:24,502 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4764.200000 2021-11-21 23:52:24,506 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:24,507 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:25,977 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4764.200000 2021-11-21 23:52:25,983 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:25,984 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:27,500 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4764.200000 2021-11-21 23:52:27,507 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:27,507 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:28,982 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4764.200000 2021-11-21 23:52:28,987 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:28,989 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:30,507 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4764.200000 2021-11-21 23:52:30,516 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:30,516 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:31,984 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4843.300000 2021-11-21 23:52:31,990 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:31,992 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:33,506 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:33,513 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:33,513 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:35,006 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:35,016 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:35,016 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:36,506 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:36,513 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:36,515 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:37,953 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:37,960 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:37,961 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:39,414 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:39,421 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:39,421 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:40,936 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4894.000000 2021-11-21 23:52:40,941 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:40,941 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:42,471 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4812.900000 2021-11-21 23:52:42,476 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:42,477 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:43,966 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.200000 2021-11-21 23:52:43,971 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:43,971 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:45,486 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.200000 2021-11-21 23:52:45,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:45,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:47,028 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.200000 2021-11-21 23:52:47,032 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:47,033 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:48,507 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.200000 2021-11-21 23:52:48,513 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:48,513 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:50,009 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.200000 2021-11-21 23:52:50,016 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:50,016 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:51,586 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4746.900000 2021-11-21 23:52:51,592 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:51,592 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:53,039 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4746.900000 2021-11-21 23:52:53,046 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:53,046 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:54,512 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.300000 2021-11-21 23:52:54,517 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:54,519 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:56,048 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.300000 2021-11-21 23:52:56,053 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:56,053 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:57,532 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.300000 2021-11-21 23:52:57,539 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:57,540 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:52:58,963 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.300000 2021-11-21 23:52:58,970 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:52:58,970 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:00,562 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.300000 2021-11-21 23:53:00,566 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:00,568 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:02,062 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4724.100000 2021-11-21 23:53:02,068 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:02,068 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:03,651 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:03,657 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:03,657 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:05,135 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:05,141 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:05,142 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:06,641 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:06,647 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:06,647 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:08,132 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:08,138 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:08,138 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:09,664 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:09,670 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:09,671 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:11,176 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.100000 2021-11-21 23:53:11,180 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:11,181 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:12,638 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4810.500000 2021-11-21 23:53:12,644 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:12,644 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:14,105 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.300000 2021-11-21 23:53:14,109 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:14,111 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:15,625 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.300000 2021-11-21 23:53:15,638 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:15,638 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:17,187 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.300000 2021-11-21 23:53:17,191 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:17,193 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:18,670 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.300000 2021-11-21 23:53:18,677 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:18,677 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:20,177 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4829.300000 2021-11-21 23:53:20,183 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:20,184 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:21,690 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4812.200000 2021-11-21 23:53:21,694 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:21,696 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:23,124 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4812.200000 2021-11-21 23:53:23,128 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:23,130 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:24,651 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4766.200000 2021-11-21 23:53:24,655 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:24,657 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:26,088 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4766.200000 2021-11-21 23:53:26,094 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:26,095 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:27,585 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4766.200000 2021-11-21 23:53:27,592 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:27,592 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:29,040 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4766.200000 2021-11-21 23:53:29,046 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:29,046 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:30,540 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4766.200000 2021-11-21 23:53:30,546 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:30,546 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:32,015 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4757.900000 2021-11-21 23:53:32,020 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:32,022 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:33,517 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:33,523 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:33,523 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:34,989 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:34,994 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:34,994 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:36,540 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:36,546 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:36,548 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:37,980 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:37,984 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:37,984 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:39,440 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:39,444 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:39,444 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:39,766 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2' completed 2021-11-21 23:53:39,767 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2' started 2021-11-21 23:53:39,903 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19' completed 2021-11-21 23:53:39,904 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2' started 2021-11-21 23:53:40,029 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19' completed 2021-11-21 23:53:40,029 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2' started 2021-11-21 23:53:40,108 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19' completed 2021-11-21 23:53:40,109 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2' started 2021-11-21 23:53:40,322 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2' completed 2021-11-21 23:53:40,322 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2' started 2021-11-21 23:53:40,344 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19' completed 2021-11-21 23:53:40,345 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2' started 2021-11-21 23:53:40,348 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2' completed 2021-11-21 23:53:40,348 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2' started 2021-11-21 23:53:40,378 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2' completed 2021-11-21 23:53:40,378 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2' started 2021-11-21 23:53:40,411 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2' completed 2021-11-21 23:53:40,411 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2' started 2021-11-21 23:53:40,428 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19' completed 2021-11-21 23:53:40,430 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2' started 2021-11-21 23:53:40,430 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19 are 20000 2021-11-21 23:53:40,430 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1800000 to 1820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:53:40,430 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:53:40,431 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19 are 20000 2021-11-21 23:53:40,433 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1820000 to 1840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:53:40,434 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:53:40,500 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2' completed 2021-11-21 23:53:40,500 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2' started 2021-11-21 23:53:40,552 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2' completed 2021-11-21 23:53:40,552 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2' started 2021-11-21 23:53:40,596 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19' completed 2021-11-21 23:53:40,598 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2' started 2021-11-21 23:53:40,611 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19' completed 2021-11-21 23:53:40,612 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2' started 2021-11-21 23:53:40,614 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19 are 20000 2021-11-21 23:53:40,615 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1800000 to 1820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19 2021-11-21 23:53:40,615 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:53:40,759 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19' completed 2021-11-21 23:53:40,760 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2' started 2021-11-21 23:53:40,776 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2' completed 2021-11-21 23:53:40,776 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2' started 2021-11-21 23:53:40,880 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19' completed 2021-11-21 23:53:40,881 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19' completed 2021-11-21 23:53:40,881 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2' started 2021-11-21 23:53:40,881 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2' started 2021-11-21 23:53:40,901 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19' completed 2021-11-21 23:53:40,901 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2' started 2021-11-21 23:53:40,903 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19 are 20000 2021-11-21 23:53:40,904 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1840000 to 1860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:53:40,904 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4844.800000 2021-11-21 23:53:40,904 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:53:40,904 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19 are 20000 2021-11-21 23:53:40,905 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1820000 to 1840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19 2021-11-21 23:53:40,907 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:53:40,907 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19 are 20000 2021-11-21 23:53:40,905 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2' completed 2021-11-21 23:53:40,908 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1860000 to 1880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:53:40,908 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2' started 2021-11-21 23:53:40,910 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:53:40,910 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:40,911 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19 are 20000 2021-11-21 23:53:40,911 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:40,911 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1840000 to 1860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19 2021-11-21 23:53:40,913 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:53:41,015 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19' completed 2021-11-21 23:53:41,015 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19' completed 2021-11-21 23:53:41,016 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2' started 2021-11-21 23:53:41,016 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2' started 2021-11-21 23:53:41,016 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19 are 20000 2021-11-21 23:53:41,016 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1880000 to 1900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:53:41,017 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:53:41,017 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19 are 20000 2021-11-21 23:53:41,019 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1860000 to 1880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19 2021-11-21 23:53:41,019 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:53:41,019 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19 are 20000 2021-11-21 23:53:41,019 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1900000 to 1920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:53:41,019 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:53:41,020 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19 are 20000 2021-11-21 23:53:41,020 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1880000 to 1900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19 2021-11-21 23:53:41,022 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19 2021-11-21 23:53:41,065 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2' completed 2021-11-21 23:53:41,065 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2' started 2021-11-21 23:53:41,068 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2' completed 2021-11-21 23:53:41,068 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2' started 2021-11-21 23:53:41,158 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2' completed 2021-11-21 23:53:41,160 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2' started 2021-11-21 23:53:41,305 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2' completed 2021-11-21 23:53:41,305 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2' started 2021-11-21 23:53:41,411 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19' completed 2021-11-21 23:53:41,413 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2' started 2021-11-21 23:53:41,413 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19 are 20000 2021-11-21 23:53:41,414 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1920000 to 1940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19 2021-11-21 23:53:41,414 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:53:41,414 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19 are 20000 2021-11-21 23:53:41,414 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1900000 to 1920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19 2021-11-21 23:53:41,415 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19 2021-11-21 23:53:41,417 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19 are 20000 2021-11-21 23:53:41,417 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1940000 to 1960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19 2021-11-21 23:53:41,417 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:53:41,418 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2 are 20000 2021-11-21 23:53:41,418 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1920000 to 1940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:53:41,420 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:53:41,421 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2 are 20000 2021-11-21 23:53:41,421 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1960000 to 1980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:53:41,421 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:53:41,421 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2 are 20000 2021-11-21 23:53:41,423 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1940000 to 1960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:53:41,423 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:53:41,424 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2 are 20000 2021-11-21 23:53:41,424 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1980000 to 2000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:53:41,424 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:53:41,426 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2 are 20000 2021-11-21 23:53:41,426 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1960000 to 1980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:53:41,427 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:53:41,427 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2 are 20000 2021-11-21 23:53:41,427 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2000000 to 2020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:53:41,428 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:53:41,428 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2 are 20000 2021-11-21 23:53:41,430 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1980000 to 2000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:53:41,430 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:53:41,430 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2 are 20000 2021-11-21 23:53:41,431 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2020000 to 2040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:53:41,431 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:53:41,433 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2 are 20000 2021-11-21 23:53:41,433 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2000000 to 2020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:53:41,434 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:53:41,434 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2 are 20000 2021-11-21 23:53:41,434 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2040000 to 2060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:53:41,434 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:53:42,434 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2' completed 2021-11-21 23:53:42,436 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2 are 20000 2021-11-21 23:53:42,436 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2' started 2021-11-21 23:53:42,437 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1800000 to 1820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:53:42,438 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:53:42,440 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2 are 20000 2021-11-21 23:53:42,440 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2060000 to 2080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:53:42,440 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2 2021-11-21 23:53:42,441 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2 are 20000 2021-11-21 23:53:42,443 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1820000 to 1840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2 2021-11-21 23:53:42,443 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:53:42,444 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2 are 20000 2021-11-21 23:53:42,444 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2020000 to 2040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:53:42,446 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2 2021-11-21 23:53:42,450 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4914.600000 2021-11-21 23:53:42,460 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:42,461 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:43,934 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:43,940 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:43,940 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:45,394 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:45,401 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:45,401 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:46,888 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:46,892 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:46,894 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:48,368 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:48,375 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:48,375 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:49,822 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:49,828 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:49,828 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:51,276 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.200000 2021-11-21 23:53:51,280 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:51,282 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:52,720 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4788.100000 2021-11-21 23:53:52,726 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:52,726 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:54,198 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.800000 2021-11-21 23:53:54,203 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:54,204 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:55,661 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.800000 2021-11-21 23:53:55,667 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:55,667 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:57,326 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.800000 2021-11-21 23:53:57,332 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:57,332 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:53:58,823 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.800000 2021-11-21 23:53:58,832 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:53:58,832 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:00,236 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4769.800000 2021-11-21 23:54:00,240 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:00,242 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:01,703 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4765.400000 2021-11-21 23:54:01,707 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:01,707 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:03,181 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4765.400000 2021-11-21 23:54:03,187 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:03,187 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:04,749 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.100000 2021-11-21 23:54:04,755 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:04,755 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:06,232 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.100000 2021-11-21 23:54:06,237 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:06,237 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:07,786 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.100000 2021-11-21 23:54:07,790 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:07,792 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:09,252 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.100000 2021-11-21 23:54:09,257 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:09,259 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:10,732 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.100000 2021-11-21 23:54:10,737 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:10,737 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:12,164 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4830.700000 2021-11-21 23:54:12,170 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:12,170 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:13,707 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:13,711 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:13,711 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:15,128 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:15,134 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:15,135 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:16,578 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:16,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:16,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:17,990 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:17,996 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:17,997 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:19,463 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:19,467 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:19,469 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:20,907 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4813.400000 2021-11-21 23:54:20,914 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:20,914 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:22,368 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4954.500000 2021-11-21 23:54:22,374 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:22,375 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:23,806 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:23,813 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:23,813 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:25,210 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:25,216 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:25,216 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:26,683 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:26,687 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:26,687 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:28,112 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:28,124 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:28,125 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:29,551 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:29,556 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:29,556 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:31,063 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 5046.000000 2021-11-21 23:54:31,071 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:31,072 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:32,520 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4992.500000 2021-11-21 23:54:32,526 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:32,528 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:34,055 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:34,062 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:34,062 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:35,486 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:35,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:35,493 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:36,937 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:36,941 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:36,941 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:38,443 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:38,448 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:38,450 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:39,927 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:39,934 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:39,934 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:41,453 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4947.300000 2021-11-21 23:54:41,459 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:41,460 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:42,927 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.900000 2021-11-21 23:54:42,933 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:42,933 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:44,438 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.200000 2021-11-21 23:54:44,444 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:44,444 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:45,960 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.200000 2021-11-21 23:54:45,966 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:45,967 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:47,450 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.200000 2021-11-21 23:54:47,456 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:47,457 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:48,953 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.200000 2021-11-21 23:54:48,960 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:48,960 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:50,448 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4762.200000 2021-11-21 23:54:50,454 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:50,456 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:51,967 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4788.500000 2021-11-21 23:54:51,977 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:51,979 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:53,444 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4788.500000 2021-11-21 23:54:53,450 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:53,451 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:54,934 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4740.700000 2021-11-21 23:54:54,940 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:54,940 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:56,444 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4740.700000 2021-11-21 23:54:56,450 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:56,451 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:57,911 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4740.700000 2021-11-21 23:54:57,917 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:57,917 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:54:59,364 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4740.700000 2021-11-21 23:54:59,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:54:59,369 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:00,816 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4740.700000 2021-11-21 23:55:00,823 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:00,825 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:03,328 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4760.200000 2021-11-21 23:55:03,336 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:03,338 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:04,752 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.300000 2021-11-21 23:55:04,756 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:04,757 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:06,311 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.300000 2021-11-21 23:55:06,315 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:06,315 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:07,854 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.300000 2021-11-21 23:55:07,859 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:07,861 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:09,328 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.300000 2021-11-21 23:55:09,335 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:09,335 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:10,766 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.300000 2021-11-21 23:55:10,772 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:10,772 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:12,243 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4658.900000 2021-11-21 23:55:12,250 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:12,250 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:13,744 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:13,750 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:13,752 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:15,263 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:15,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:15,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:16,838 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:16,842 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:16,844 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:18,395 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:18,404 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:18,404 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:19,845 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:19,849 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:19,851 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:21,332 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4512.700000 2021-11-21 23:55:21,336 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:21,338 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:22,798 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4567.800000 2021-11-21 23:55:22,802 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:22,803 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:24,256 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.500000 2021-11-21 23:55:24,262 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:24,263 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:25,767 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.500000 2021-11-21 23:55:25,773 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:25,773 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:27,364 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.500000 2021-11-21 23:55:27,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:27,369 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:28,823 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.500000 2021-11-21 23:55:28,829 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:28,831 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:30,296 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4570.500000 2021-11-21 23:55:30,301 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:30,302 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:31,826 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4567.500000 2021-11-21 23:55:31,835 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:31,835 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:33,318 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4567.500000 2021-11-21 23:55:33,323 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:33,325 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:34,914 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4640.600000 2021-11-21 23:55:34,921 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:34,921 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:36,403 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4640.600000 2021-11-21 23:55:36,408 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:36,410 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:37,115 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2' completed 2021-11-21 23:55:37,119 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2' started 2021-11-21 23:55:37,119 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2 are 20000 2021-11-21 23:55:37,121 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1840000 to 1860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2 2021-11-21 23:55:37,121 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:55:37,289 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2' completed 2021-11-21 23:55:37,290 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2' started 2021-11-21 23:55:37,700 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2' completed 2021-11-21 23:55:37,701 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2' started 2021-11-21 23:55:37,802 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2' completed 2021-11-21 23:55:37,802 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2' started 2021-11-21 23:55:37,803 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2 are 20000 2021-11-21 23:55:37,805 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2040000 to 2060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:55:37,805 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:37,865 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4640.600000 2021-11-21 23:55:37,871 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:37,872 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:37,877 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2' completed 2021-11-21 23:55:37,877 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2' started 2021-11-21 23:55:37,983 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2' completed 2021-11-21 23:55:37,984 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21' started 2021-11-21 23:55:37,984 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2 are 20000 2021-11-21 23:55:37,986 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2080000 to 2100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:37,986 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2 2021-11-21 23:55:38,105 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2' completed 2021-11-21 23:55:38,105 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21' started 2021-11-21 23:55:38,122 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2' completed 2021-11-21 23:55:38,124 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21' started 2021-11-21 23:55:38,151 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2' completed 2021-11-21 23:55:38,151 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21' started 2021-11-21 23:55:38,319 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2' completed 2021-11-21 23:55:38,319 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21' started 2021-11-21 23:55:38,325 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2' completed 2021-11-21 23:55:38,325 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21' started 2021-11-21 23:55:38,424 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2' completed 2021-11-21 23:55:38,424 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21' started 2021-11-21 23:55:38,492 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2' completed 2021-11-21 23:55:38,493 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21' started 2021-11-21 23:55:38,505 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2' completed 2021-11-21 23:55:38,506 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21' started 2021-11-21 23:55:38,506 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2 are 20000 2021-11-21 23:55:38,506 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1860000 to 1880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2 2021-11-21 23:55:38,506 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:55:38,551 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2' completed 2021-11-21 23:55:38,551 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21' started 2021-11-21 23:55:38,551 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2 are 20000 2021-11-21 23:55:38,552 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2060000 to 2080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:55:38,552 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:38,595 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2' completed 2021-11-21 23:55:38,596 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21' started 2021-11-21 23:55:38,743 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2' completed 2021-11-21 23:55:38,743 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2' completed 2021-11-21 23:55:38,743 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21' started 2021-11-21 23:55:38,744 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21' started 2021-11-21 23:55:38,789 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2' completed 2021-11-21 23:55:38,790 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21' started 2021-11-21 23:55:38,859 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2' completed 2021-11-21 23:55:38,861 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21' started 2021-11-21 23:55:38,884 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2' completed 2021-11-21 23:55:38,885 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21' started 2021-11-21 23:55:38,913 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2' completed 2021-11-21 23:55:38,914 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21' started 2021-11-21 23:55:38,982 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2' completed 2021-11-21 23:55:38,983 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21' started 2021-11-21 23:55:38,983 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2 are 20000 2021-11-21 23:55:38,984 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2100000 to 2120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:38,984 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2 2021-11-21 23:55:38,986 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2 are 20000 2021-11-21 23:55:38,986 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1880000 to 1900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2 2021-11-21 23:55:38,986 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:55:39,058 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2' completed 2021-11-21 23:55:39,059 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2 are 20000 2021-11-21 23:55:39,059 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21' started 2021-11-21 23:55:39,059 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2120000 to 2140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:55:39,061 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:39,061 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2 are 20000 2021-11-21 23:55:39,062 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2080000 to 2100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:39,062 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2 2021-11-21 23:55:39,062 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2 are 20000 2021-11-21 23:55:39,063 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1900000 to 1920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2 2021-11-21 23:55:39,065 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:55:39,065 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2 are 20000 2021-11-21 23:55:39,065 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2140000 to 2160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:55:39,065 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:55:39,194 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2' completed 2021-11-21 23:55:39,265 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2' completed 2021-11-21 23:55:39,266 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2 are 20000 2021-11-21 23:55:39,266 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1920000 to 1940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2 2021-11-21 23:55:39,267 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:39,267 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2 are 20000 2021-11-21 23:55:39,269 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2100000 to 2120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:39,269 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:55:39,269 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2 are 20000 2021-11-21 23:55:39,269 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2160000 to 2180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:55:39,270 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:55:39,272 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2 are 20000 2021-11-21 23:55:39,272 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1940000 to 1960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2 2021-11-21 23:55:39,273 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:55:39,273 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2 are 20000 2021-11-21 23:55:39,273 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2120000 to 2140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:55:39,273 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:55:39,322 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4640.600000 2021-11-21 23:55:39,328 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:39,328 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:39,384 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2' completed 2021-11-21 23:55:39,384 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2 are 20000 2021-11-21 23:55:39,385 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2180000 to 2200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:55:39,387 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:55:39,387 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2 are 20000 2021-11-21 23:55:39,388 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1960000 to 1980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2 2021-11-21 23:55:39,388 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:55:39,539 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2' completed 2021-11-21 23:55:39,539 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2 are 20000 2021-11-21 23:55:39,540 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2140000 to 2160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:55:39,540 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:55:39,542 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2 are 20000 2021-11-21 23:55:39,542 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1980000 to 2000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2 2021-11-21 23:55:39,542 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:55:39,543 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2 are 20000 2021-11-21 23:55:39,545 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2160000 to 2180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:55:39,545 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:55:39,546 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2 are 20000 2021-11-21 23:55:39,546 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2000000 to 2020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2 2021-11-21 23:55:39,548 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:55:39,548 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2 are 20000 2021-11-21 23:55:39,549 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2020000 to 2040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2 2021-11-21 23:55:39,549 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:55:39,551 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2 are 20000 2021-11-21 23:55:39,551 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2180000 to 2200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:55:39,552 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:55:39,552 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2 are 20000 2021-11-21 23:55:39,553 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2040000 to 2060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2 2021-11-21 23:55:39,555 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:55:39,555 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2 are 20000 2021-11-21 23:55:39,555 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2060000 to 2080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2 2021-11-21 23:55:39,556 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:39,558 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2 are 20000 2021-11-21 23:55:39,558 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2080000 to 2100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2 2021-11-21 23:55:39,559 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:39,559 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2 are 20000 2021-11-21 23:55:39,561 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2100000 to 2120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2 2021-11-21 23:55:39,561 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:55:40,818 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4640.600000 2021-11-21 23:55:40,822 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:40,823 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:42,263 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4645.800000 2021-11-21 23:55:42,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:42,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:43,789 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:43,796 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:43,796 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:45,263 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:45,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:45,269 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:46,714 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:46,720 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:46,720 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:48,163 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:48,168 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:48,168 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:49,598 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:49,602 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:49,604 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:51,065 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4661.900000 2021-11-21 23:55:51,071 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:51,071 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:52,517 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4723.200000 2021-11-21 23:55:52,525 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:52,526 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:54,022 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:55:54,028 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:54,029 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:55,617 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:55:55,621 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:55,622 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:57,105 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:55:57,111 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:57,112 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:58,536 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:55:58,543 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:58,543 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:55:59,980 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:55:59,986 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:55:59,986 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:01,497 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4725.500000 2021-11-21 23:56:01,505 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:01,506 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:02,940 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4656.400000 2021-11-21 23:56:02,947 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:02,947 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:04,474 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4623.700000 2021-11-21 23:56:04,482 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:04,483 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:10,917 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4623.700000 2021-11-21 23:56:10,924 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:10,924 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:17,361 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4632.700000 2021-11-21 23:56:17,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:17,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:19,463 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4631.300000 2021-11-21 23:56:19,467 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:19,467 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:25,921 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4631.300000 2021-11-21 23:56:25,928 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:25,928 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:32,361 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4349.000000 2021-11-21 23:56:32,367 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:32,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:37,622 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4412.700000 2021-11-21 23:56:37,628 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:37,628 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:41,207 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4412.700000 2021-11-21 23:56:41,213 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:41,213 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:42,676 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4238.500000 2021-11-21 23:56:42,681 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:42,683 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:44,163 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4084.500000 2021-11-21 23:56:44,167 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:44,168 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:45,637 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4084.500000 2021-11-21 23:56:45,641 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:45,641 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:47,131 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4084.500000 2021-11-21 23:56:47,135 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:47,137 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:48,592 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4084.500000 2021-11-21 23:56:48,598 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:48,598 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:50,131 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4084.500000 2021-11-21 23:56:50,140 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:50,141 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:51,657 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:56:51,663 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:51,664 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:53,108 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4090.100000 2021-11-21 23:56:53,112 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:53,112 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:54,538 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4198.200000 2021-11-21 23:56:54,542 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:54,543 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:56,012 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4198.200000 2021-11-21 23:56:56,017 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:56,019 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:57,464 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4198.200000 2021-11-21 23:56:57,470 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:57,471 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:56:58,986 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4198.200000 2021-11-21 23:56:58,993 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:56:58,993 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:00,515 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4198.200000 2021-11-21 23:57:00,519 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:00,520 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:02,099 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4205.000000 2021-11-21 23:57:02,105 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:02,105 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:03,602 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:03,608 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:03,608 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:05,239 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:05,243 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:05,244 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:06,737 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:06,743 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:06,743 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:08,266 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:08,273 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:08,273 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:09,839 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:09,844 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:09,845 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:11,362 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4070.500000 2021-11-21 23:57:11,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:11,368 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:12,960 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3409.000000 2021-11-21 23:57:12,964 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:12,964 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:14,492 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2754.900000 2021-11-21 23:57:14,497 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:14,499 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:16,091 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2754.900000 2021-11-21 23:57:16,096 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:16,098 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:17,562 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2754.900000 2021-11-21 23:57:17,569 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:17,569 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:19,088 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2754.900000 2021-11-21 23:57:19,094 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:19,095 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:20,608 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2754.900000 2021-11-21 23:57:20,614 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:20,615 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:22,111 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2715.400000 2021-11-21 23:57:22,118 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:22,118 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:23,579 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:23,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:23,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:25,059 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:25,065 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:25,065 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:26,627 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:26,632 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:26,634 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:28,142 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:28,148 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:28,148 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:29,677 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:29,684 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:29,684 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:31,194 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 2876.300000 2021-11-21 23:57:31,200 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:31,201 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:32,642 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 3595.900000 2021-11-21 23:57:32,648 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:32,650 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:34,130 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4231.100000 2021-11-21 23:57:34,137 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:34,137 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:34,210 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21' completed 2021-11-21 23:57:34,424 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21' completed 2021-11-21 23:57:34,492 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21' completed 2021-11-21 23:57:34,628 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2' completed 2021-11-21 23:57:34,654 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21' completed 2021-11-21 23:57:34,691 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2' completed 2021-11-21 23:57:34,773 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21' completed 2021-11-21 23:57:34,832 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2' completed 2021-11-21 23:57:34,832 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2 are 20000 2021-11-21 23:57:34,832 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2120000 to 2140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2 2021-11-21 23:57:34,834 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:57:34,835 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2 are 20000 2021-11-21 23:57:34,835 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2140000 to 2160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2 2021-11-21 23:57:34,835 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:57:34,857 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21' completed 2021-11-21 23:57:34,861 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21' completed 2021-11-21 23:57:34,898 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21' completed 2021-11-21 23:57:34,900 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21' completed 2021-11-21 23:57:34,921 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21' completed 2021-11-21 23:57:34,930 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21' completed 2021-11-21 23:57:34,938 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21' completed 2021-11-21 23:57:34,944 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21' completed 2021-11-21 23:57:34,983 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21' completed 2021-11-21 23:57:35,006 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21' completed 2021-11-21 23:57:35,036 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21' completed 2021-11-21 23:57:35,055 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21' completed 2021-11-21 23:57:35,122 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21' completed 2021-11-21 23:57:35,252 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21' completed 2021-11-21 23:57:35,352 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2' completed 2021-11-21 23:57:35,563 | test | DEBUG | pool-3-thread-24 | [task:record_bucket_ops:3570] Ops rate for 'default': 4231.100000 2021-11-21 23:57:35,568 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:35,568 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:35,930 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2' completed 2021-11-21 23:57:35,930 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2 are 20000 2021-11-21 23:57:35,930 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2160000 to 2180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2 2021-11-21 23:57:35,931 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:57:35,931 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2 are 20000 2021-11-21 23:57:35,933 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2180000 to 2200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2 2021-11-21 23:57:35,933 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:57:35,934 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2 are 20000 2021-11-21 23:57:35,934 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1800000 to 1820000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2 2021-11-21 23:57:35,934 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21 2021-11-21 23:57:35,934 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21 are 20000 2021-11-21 23:57:35,936 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1820000 to 1840000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21 2021-11-21 23:57:35,936 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21 2021-11-21 23:57:35,937 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21 are 20000 2021-11-21 23:57:35,937 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1840000 to 1860000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21 2021-11-21 23:57:35,937 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21 2021-11-21 23:57:35,937 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21 are 20000 2021-11-21 23:57:35,938 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1860000 to 1880000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21 2021-11-21 23:57:35,938 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21 2021-11-21 23:57:35,938 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21 are 20000 2021-11-21 23:57:35,940 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1880000 to 1900000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21 2021-11-21 23:57:35,940 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21 2021-11-21 23:57:35,940 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21 are 20000 2021-11-21 23:57:35,940 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1900000 to 1920000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21 2021-11-21 23:57:35,941 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21 2021-11-21 23:57:35,941 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21 are 20000 2021-11-21 23:57:35,943 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1920000 to 1940000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21 2021-11-21 23:57:35,943 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21 2021-11-21 23:57:35,944 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21 are 20000 2021-11-21 23:57:35,944 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1940000 to 1960000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21 2021-11-21 23:57:35,944 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21 2021-11-21 23:57:35,946 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21 are 20000 2021-11-21 23:57:35,946 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1960000 to 1980000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21 2021-11-21 23:57:35,947 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21 2021-11-21 23:57:35,947 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21 are 20000 2021-11-21 23:57:35,947 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 1980000 to 2000000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21 2021-11-21 23:57:35,947 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21 2021-11-21 23:57:35,948 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21 are 20000 2021-11-21 23:57:35,948 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2000000 to 2020000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21 2021-11-21 23:57:35,950 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21 2021-11-21 23:57:35,950 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21 are 20000 2021-11-21 23:57:35,950 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2020000 to 2040000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21 2021-11-21 23:57:35,950 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21 2021-11-21 23:57:35,951 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21 are 20000 2021-11-21 23:57:35,951 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2040000 to 2060000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21 2021-11-21 23:57:35,953 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21 2021-11-21 23:57:35,953 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21 are 20000 2021-11-21 23:57:35,953 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2060000 to 2080000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21 2021-11-21 23:57:35,953 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21 2021-11-21 23:57:35,954 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21 are 20000 2021-11-21 23:57:35,956 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2080000 to 2100000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21 2021-11-21 23:57:35,956 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21 2021-11-21 23:57:35,957 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21 are 20000 2021-11-21 23:57:35,957 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2100000 to 2120000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21 2021-11-21 23:57:35,957 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21 2021-11-21 23:57:35,957 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21 are 20000 2021-11-21 23:57:35,959 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2120000 to 2140000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21 2021-11-21 23:57:35,959 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21 2021-11-21 23:57:35,960 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21 are 20000 2021-11-21 23:57:35,960 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2140000 to 2160000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21 2021-11-21 23:57:35,960 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21 2021-11-21 23:57:35,960 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21 are 20000 2021-11-21 23:57:35,961 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2160000 to 2180000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21 2021-11-21 23:57:35,961 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21 2021-11-21 23:57:35,963 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21 are 20000 2021-11-21 23:57:35,963 | test | DEBUG | pool-3-thread-10 | [task:execute_tasks:3915] Failed to load 0 docs from 2180000 to 2200000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21 2021-11-21 23:57:35,963 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637567504.21 2021-11-21 23:57:36,575 | test | INFO | pool-3-thread-24 | [table_view:display:72] Ops trend for bucket 'default' +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *****.................................*.........................................******.............*......******.X | 4783.400 | | 4761.900 | .............................................................................................****X | 4761.900 | | 4726.000 | ............................................................................................**.*****.*.*****X | 4894.000 | | 4812.900 | ..............................................................................................X | 4812.900 | | 4741.200 | ............................................................................................*****.*X | 4746.900 | | 4718.300 | ............................................................................................******.******.*****X | 4829.300 | | 4812.200 | ..............................................................................................*X | 4812.200 | | 4766.200 | .............................................................................................****X | 4766.200 | | 4757.900 | .............................................................................................*..******.X | 4914.600 | | 4859.200 | ...............................................................................................*****X | 4859.200 | | 4788.100 | .............................................................................................X | 4788.100 | | 4769.800 | .............................................................................................****X | 4769.800 | | 4765.400 | .............................................................................................**.*****X | 4830.700 | | 4813.400 | ..............................................................................................******...*..*****X | 5046.000 | | 4992.500 | .................................................................................................X | 4992.500 | | 4947.300 | .................................................................................................*****X | 4947.300 | | 4815.900 | ..............................................................................................X | 4815.900 | | 4762.200 | .............................................................................................******X | 4788.500 | | 4740.700 | ............................................................................................*****.*.****X | 4804.300 | | 4658.900 | ...........................................................................................X | 4658.900 | | 4512.700 | ........................................................................................******.*****X | 4570.500 | | 4567.500 | .........................................................................................**.*****.*******.******X | 4725.500 | | 4656.400 | ...........................................................................................X | 4656.400 | | 4623.700 | ..........................................................................................**X | 4632.700 | | 4631.300 | ..........................................................................................*X | 4631.300 | | 4349.000 | .....................................................................................*.*X | 4412.700 | | 4238.500 | ..................................................................................X | 4238.500 | | 4084.500 | ...............................................................................*****.**..*****X | 4205.000 | | 4070.500 | ...............................................................................*****X | 4070.500 | | 3409.000 | ..................................................................X | 3409.000 | | 2754.900 | .....................................................****X | 2754.900 | | 2715.400 | ....................................................*....******..............*............*X | 4231.100 | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:57:36,575 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637567504.21' completed 2021-11-21 23:57:36,575 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:57:36,576 | infra | WARNING | pool-3-thread-10 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637567504.09' not completed 2021-11-21 23:57:36,576 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:57:36,578 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1800000_1820000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,578 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1820000_1840000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,578 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,579 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1840000_1860000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,581 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,581 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1860000_1880000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,582 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,582 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1880000_1900000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,582 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,582 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1900000_1920000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,584 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,584 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1920000_1940000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,585 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,585 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1940000_1960000_1637567504.19' complete. Loaded 20000 items 2021-11-21 23:57:36,585 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,585 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1960000_1980000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,586 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,586 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_1980000_2000000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,588 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,588 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2000000_2020000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,588 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,588 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2020000_2040000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,589 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,589 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2040000_2060000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,591 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1800000_1820000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,591 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2060000_2080000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,592 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1820000_1840000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,592 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,592 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1840000_1860000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,592 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,594 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2080000_2100000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,594 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1860000_1880000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,595 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,595 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2100000_2120000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,595 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1880000_1900000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,595 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2120000_2140000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,595 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,596 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1900000_1920000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,596 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2140000_2160000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,598 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1920000_1940000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,598 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,598 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2160000_2180000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,599 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1940000_1960000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,599 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,599 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default__default_ttl=0_create_NONE_2180000_2200000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,601 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1960000_1980000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,601 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,601 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_1980000_2000000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,601 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,602 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2000000_2020000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,602 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2020000_2040000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,604 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default__default_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,604 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2040000_2060000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,605 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2060000_2080000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,605 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2080000_2100000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,605 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2100000_2120000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,605 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2120000_2140000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,607 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2140000_2160000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,607 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2160000_2180000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,608 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2180000_2200000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,608 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1800000_1820000_1637567504.2' complete. Loaded 20000 items 2021-11-21 23:57:36,608 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1820000_1840000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,608 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1840000_1860000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,609 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1860000_1880000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,609 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1880000_1900000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,611 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1900000_1920000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,611 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1920000_1940000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,611 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1940000_1960000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,611 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1960000_1980000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,612 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_1980000_2000000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,612 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2000000_2020000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,614 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2020000_2040000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,614 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2040000_2060000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,615 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2060000_2080000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,615 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2080000_2100000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,615 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2100000_2120000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,615 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2120000_2140000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,617 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2140000_2160000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,617 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2160000_2180000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,618 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567504.09_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2180000_2200000_1637567504.21' complete. Loaded 20000 items 2021-11-21 23:57:36,655 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'PrintBucketStats_default_1637567856.62' started 2021-11-21 23:57:36,655 | infra | INFO | pool-3-thread-10 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637567856.62 2021-11-21 23:57:36,657 | infra | DEBUG | pool-3-thread-10 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637567856.62 2021-11-21 23:57:37,052 | test | DEBUG | pool-3-thread-17 | [task:record_bucket_ops:3570] Ops rate for 'default': 4231.100000 2021-11-21 23:57:37,055 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:37,055 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:38,058 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'default' +----------+------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+------------------------------------------------------------------------------------------------------+----------+ | 4231.100 | ...................................................................................................X | 4231.100 | +----------+------------------------------------------------------------------------------------------------------+----------+ 2021-11-21 23:57:38,059 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637567856.62' completed 2021-11-21 23:57:38,059 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-21 23:57:38,061 | infra | WARNING | pool-3-thread-10 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637567504.09' not completed 2021-11-21 23:57:38,061 | infra | DEBUG | pool-3-thread-10 | [task:execute_tasks:3934] ====================================== 2021-11-21 23:57:38,062 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637567504.09' completed 2021-11-21 23:57:38,250 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-21 23:57:38,265 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-21 23:57:38,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:57:38,900 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-21 23:57:39,035 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:57:39,036 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-21 23:57:39,066 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-21 23:57:39,098 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-21 23:57:39,127 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-21 23:57:39,164 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-21 23:57:39,194 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-21 23:57:39,226 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-21 23:57:39,259 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:57:39,260 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637567859.26 2021-11-21 23:57:39,262 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567859.26' started 2021-11-21 23:57:39,263 | infra | DEBUG | pool-3-thread-22 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:57:39,276 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-21 23:57:39,586 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-21 23:57:39,891 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-21 23:57:40,030 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-21 23:57:40,032 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-21 23:57:40,061 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-21 23:57:40,091 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-21 23:57:40,121 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-21 23:57:40,154 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-21 23:57:40,184 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-21 23:57:40,203 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-21 23:57:40,233 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-21 23:57:40,234 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637567860.23 2021-11-21 23:57:40,234 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567860.23' started 2021-11-21 23:57:40,234 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637567859.26 2021-11-21 23:57:40,236 | infra | DEBUG | pool-3-thread-21 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-21 23:57:41,691 | test | DEBUG | pool-3-thread-22 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:57:41,693 | test | DEBUG | pool-3-thread-22 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-21 23:57:41,693 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567859.26' completed 2021-11-21 23:57:41,694 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-21 23:57:41,694 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637567860.23 2021-11-21 23:57:42,736 | test | DEBUG | pool-3-thread-21 | [task:_compare:2725] Comparing 0 == 0 2021-11-21 23:57:42,737 | test | DEBUG | pool-3-thread-21 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-21 23:57:42,739 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637567860.23' completed 2021-11-21 23:57:42,740 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-21 23:57:42,740 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:642] Added items from 1800000 to 2200000 2021-11-21 23:57:42,740 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.221:9102/ 2021-11-21 23:57:42,743 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.221:9102/stats/storage 2021-11-21 23:57:42,809 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection1_0 2021-11-21 23:57:42,811 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:57:42,811 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.23456 2021-11-21 23:57:42,812 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default_FunctionCollection1_0 2021-11-21 23:57:42,812 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:57:42,812 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.14203 2021-11-21 23:57:42,812 | test | DEBUG | MainThread | [plasma_stats_util:get_index_baseURL:33] Index URL is http://172.23.105.220:9102/ 2021-11-21 23:57:42,813 | test | INFO | MainThread | [plasma_stats_util:get_index_storage_stats:40] api is:http://172.23.105.220:9102/stats/storage 2021-11-21 23:57:42,880 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default_Scope1_FunctionCollection0_0 2021-11-21 23:57:42,881 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:57:42,881 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.8371 2021-11-21 23:57:42,881 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:135] index name is:default__default__default_0 2021-11-21 23:57:42,881 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:143] field is:resident_ratio 2021-11-21 23:57:42,882 | test | DEBUG | MainThread | [plasma_base:get_plasma_index_stat_value:144] field value is: 0.81394 2021-11-21 23:57:42,882 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.23 and expected value: 0.99 2021-11-21 23:57:42,884 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:57:42,884 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.14 and expected value: 0.99 2021-11-21 23:57:42,884 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:57:42,884 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.84 and expected value: 0.99 2021-11-21 23:57:42,885 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:57:42,885 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:168] field value: 0.81 and expected value: 0.99 2021-11-21 23:57:42,887 | test | DEBUG | MainThread | [plasma_base:validate_plasma_stat_field_value:180] lesser operation 2021-11-21 23:57:42,888 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:659] self.create is 2200000 self.create_end is 2640000.0 self.delete_start is 0 self.delete_end is 528000.0 self.update_start is 1056000.0 self.update_end is 1584000.0 2021-11-21 23:57:42,905 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:664] initial_items_in_each_collection 2200000 2021-11-21 23:57:42,940 | infra | DEBUG | MainThread | [cluster:async_load_gen_docs_from_spec:105] Initializing mutation task for given spec 2021-11-21 23:57:42,940 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: MutateDocsFromSpecTask_1637567862.94 2021-11-21 23:57:42,940 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'MutateDocsFromSpecTask_1637567862.94' started 2021-11-21 23:57:42,940 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for MutateDocsFromSpecTask_1637567862.94 2021-11-21 23:57:43,250 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637567863.21 2021-11-21 23:57:43,250 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'PrintBucketStats_default_1637567863.21' started 2021-11-21 23:57:43,250 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:57:43,250 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03' started 2021-11-21 23:57:43,252 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:57:43,252 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03' started 2021-11-21 23:57:43,252 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:57:43,255 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:57:43,255 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03' started 2021-11-21 23:57:43,253 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03' started 2021-11-21 23:57:43,256 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03' started 2021-11-21 23:57:43,255 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:57:43,259 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:57:43,259 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03' started 2021-11-21 23:57:43,260 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:57:43,260 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03' started 2021-11-21 23:57:43,263 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:57:43,265 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:57:43,265 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:57:43,266 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:57:43,266 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:57:43,266 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:57:43,267 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:57:43,267 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:57:43,269 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03' started 2021-11-21 23:57:43,269 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:57:43,269 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03' started 2021-11-21 23:57:43,269 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03' started 2021-11-21 23:57:43,270 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03' started 2021-11-21 23:57:43,269 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03' started 2021-11-21 23:57:43,273 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03' started 2021-11-21 23:57:43,275 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03' started 2021-11-21 23:57:43,272 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03' started 2021-11-21 23:57:43,273 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:57:43,279 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:57:43,279 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03' started 2021-11-21 23:57:43,279 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:57:43,279 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03' started 2021-11-21 23:57:43,279 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03' started 2021-11-21 23:57:43,285 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03' started 2021-11-21 23:57:43,288 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:57:43,289 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:57:43,289 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03' started 2021-11-21 23:57:43,288 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03' started 2021-11-21 23:57:43,293 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03 2021-11-21 23:57:43,293 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:57:43,295 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04' started 2021-11-21 23:57:43,295 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:57:43,296 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:57:43,293 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03' started 2021-11-21 23:57:43,296 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:57:43,296 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:57:43,296 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04' started 2021-11-21 23:57:43,298 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04' started 2021-11-21 23:57:43,298 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04' started 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04' started 2021-11-21 23:57:43,299 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04' started 2021-11-21 23:57:43,302 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-21 23:57:43,302 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-21 23:57:43,302 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-21 23:57:43,303 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-21 23:57:43,305 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-21 23:57:43,305 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-21 23:57:43,305 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-21 23:57:43,305 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-21 23:57:43,305 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-21 23:57:43,306 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-21 23:57:43,306 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-21 23:57:43,308 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-21 23:57:43,308 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-21 23:57:43,309 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-21 23:57:43,309 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-21 23:57:43,309 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-21 23:57:43,309 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-21 23:57:43,311 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-21 23:57:43,312 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-21 23:57:43,312 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-21 23:57:43,313 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-21 23:57:43,313 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-21 23:57:43,315 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-21 23:57:43,315 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-21 23:57:43,315 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-21 23:57:43,315 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-21 23:57:43,316 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-21 23:57:43,318 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-21 23:57:43,318 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-21 23:57:43,319 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04 2021-11-21 23:57:43,319 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04 2021-11-21 23:57:43,319 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04 2021-11-21 23:57:43,321 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04 2021-11-21 23:57:43,321 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04 2021-11-21 23:57:43,322 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04 2021-11-21 23:57:43,322 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04 2021-11-21 23:57:43,323 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05 2021-11-21 23:57:43,323 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05 2021-11-21 23:57:43,325 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05 2021-11-21 23:57:43,325 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05 2021-11-21 23:57:43,325 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05 2021-11-21 23:57:43,326 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05 2021-11-21 23:57:43,326 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05 2021-11-21 23:57:43,328 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05 2021-11-21 23:57:43,328 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05 2021-11-21 23:57:43,328 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05 2021-11-21 23:57:43,329 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05 2021-11-21 23:57:43,329 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05 2021-11-21 23:57:43,331 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05 2021-11-21 23:57:43,331 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11 2021-11-21 23:57:43,332 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11 2021-11-21 23:57:43,332 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11 2021-11-21 23:57:43,335 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11 2021-11-21 23:57:43,335 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-21 23:57:43,335 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-21 23:57:43,336 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-21 23:57:43,336 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-21 23:57:43,338 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-21 23:57:43,338 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-21 23:57:43,338 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-21 23:57:43,339 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-21 23:57:43,339 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-21 23:57:43,341 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-21 23:57:43,342 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-21 23:57:43,342 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-21 23:57:43,342 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-21 23:57:43,344 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-21 23:57:43,345 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-21 23:57:43,345 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-21 23:57:43,345 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-21 23:57:43,345 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-21 23:57:43,346 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12 2021-11-21 23:57:43,346 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12 2021-11-21 23:57:43,348 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-21 23:57:43,348 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-21 23:57:43,348 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-21 23:57:43,348 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-21 23:57:43,349 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-21 23:57:43,351 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-21 23:57:43,351 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-21 23:57:43,351 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-21 23:57:43,352 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-21 23:57:43,352 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-21 23:57:43,354 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-21 23:57:43,355 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-21 23:57:43,355 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-21 23:57:43,355 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-21 23:57:43,355 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-21 23:57:43,357 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-21 23:57:43,357 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-21 23:57:43,358 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-21 23:57:43,359 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-21 23:57:43,361 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-21 23:57:43,361 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-21 23:57:43,361 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-21 23:57:43,362 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-21 23:57:43,362 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-21 23:57:43,364 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-21 23:57:43,365 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-21 23:57:43,365 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-21 23:57:43,365 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-21 23:57:43,367 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-21 23:57:43,368 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-21 23:57:43,368 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-21 23:57:43,369 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-21 23:57:43,369 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-21 23:57:43,371 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-21 23:57:43,371 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13 2021-11-21 23:57:43,371 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13 2021-11-21 23:57:43,372 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-21 23:57:43,372 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-21 23:57:43,374 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13 2021-11-21 23:57:43,375 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-21 23:57:43,375 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-21 23:57:43,375 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-21 23:57:43,377 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13 2021-11-21 23:57:43,377 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-21 23:57:43,378 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13 2021-11-21 23:57:43,380 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-21 23:57:43,381 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13 2021-11-21 23:57:43,381 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-21 23:57:43,381 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13 2021-11-21 23:57:43,382 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13 2021-11-21 23:57:43,384 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-21 23:57:43,384 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-21 23:57:43,384 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-21 23:57:43,385 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-21 23:57:43,387 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-21 23:57:43,388 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-21 23:57:43,388 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-21 23:57:43,388 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-21 23:57:43,390 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-21 23:57:43,391 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-21 23:57:43,391 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-21 23:57:43,392 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-21 23:57:43,394 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-21 23:57:43,394 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-21 23:57:43,394 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-21 23:57:43,395 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-21 23:57:43,397 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-21 23:57:43,397 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-21 23:57:43,398 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-21 23:57:43,398 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-21 23:57:43,400 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-21 23:57:43,400 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-21 23:57:43,401 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-21 23:57:43,401 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-21 23:57:43,403 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-21 23:57:43,403 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-21 23:57:43,404 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-21 23:57:43,404 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-21 23:57:43,405 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-21 23:57:43,407 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-21 23:57:43,407 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-21 23:57:43,407 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-21 23:57:43,408 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-21 23:57:43,410 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-21 23:57:43,410 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-21 23:57:43,411 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-21 23:57:43,411 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-21 23:57:43,413 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-21 23:57:43,413 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-21 23:57:43,414 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-21 23:57:43,414 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-21 23:57:43,415 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-21 23:57:43,415 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-21 23:57:43,417 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-21 23:57:43,417 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-21 23:57:43,418 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-21 23:57:43,418 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-21 23:57:43,420 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-21 23:57:43,421 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-21 23:57:43,421 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-21 23:57:43,421 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-21 23:57:43,423 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-21 23:57:43,424 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-21 23:57:43,424 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-21 23:57:43,424 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-21 23:57:43,426 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-21 23:57:43,427 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-21 23:57:43,427 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-21 23:57:43,427 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-21 23:57:43,428 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-21 23:57:43,430 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-21 23:57:43,430 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-21 23:57:43,430 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-21 23:57:43,431 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-21 23:57:43,433 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-21 23:57:43,433 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-21 23:57:43,434 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21 2021-11-21 23:57:43,434 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21 2021-11-21 23:57:43,434 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21 2021-11-21 23:57:43,436 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21 2021-11-21 23:57:43,436 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21 2021-11-21 23:57:43,437 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21 2021-11-21 23:57:43,437 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21 2021-11-21 23:57:43,437 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21 2021-11-21 23:57:43,437 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21 2021-11-21 23:57:43,438 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21 2021-11-21 23:57:43,438 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21 2021-11-21 23:57:43,440 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21 2021-11-21 23:57:43,440 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21 2021-11-21 23:57:43,440 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21 2021-11-21 23:57:43,440 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21 2021-11-21 23:57:43,441 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21 2021-11-21 23:57:43,443 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21 2021-11-21 23:57:43,443 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21 2021-11-21 23:57:43,444 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21 2021-11-21 23:57:43,444 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21 2021-11-21 23:57:43,444 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:57:43,710 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:43,716 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:43,716 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:45,188 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:45,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:45,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:46,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:46,696 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:46,696 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:48,223 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:48,227 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:48,229 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:49,688 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:49,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:49,696 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:51,142 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 1556.200000 2021-11-21 23:57:51,148 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:51,150 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:52,601 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 2814.800000 2021-11-21 23:57:52,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:52,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:54,075 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-21 23:57:54,079 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:54,081 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:55,569 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-21 23:57:55,575 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:55,575 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:57,104 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-21 23:57:57,109 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:57,111 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:57:58,607 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-21 23:57:58,612 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:57:58,614 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:00,075 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-21 23:58:00,082 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:00,084 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:01,601 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6116.200000 2021-11-21 23:58:01,607 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:01,608 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:03,135 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6116.200000 2021-11-21 23:58:03,142 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:03,144 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:04,671 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6526.100000 2021-11-21 23:58:04,677 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:04,677 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:06,137 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6526.100000 2021-11-21 23:58:06,142 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:06,144 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:07,694 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6526.100000 2021-11-21 23:58:07,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:07,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:09,295 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6526.100000 2021-11-21 23:58:09,301 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:09,302 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:10,801 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6526.100000 2021-11-21 23:58:10,806 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:10,808 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:12,348 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6505.500000 2021-11-21 23:58:12,354 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:12,355 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:13,867 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:13,874 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:13,875 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:15,357 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:15,364 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:15,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:16,815 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:16,822 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:16,822 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:18,329 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:18,335 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:18,335 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:19,862 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:19,868 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:19,869 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:21,286 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6445.100000 2021-11-21 23:58:21,292 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:21,293 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:22,872 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6441.100000 2021-11-21 23:58:22,878 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:22,878 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:24,437 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.800000 2021-11-21 23:58:24,443 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:24,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:25,937 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.800000 2021-11-21 23:58:25,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:25,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:27,437 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.800000 2021-11-21 23:58:27,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:27,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:28,937 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.800000 2021-11-21 23:58:28,946 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:28,947 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:30,431 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.800000 2021-11-21 23:58:30,438 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:30,440 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:31,946 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6106.300000 2021-11-21 23:58:31,951 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:31,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:33,471 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6106.300000 2021-11-21 23:58:33,477 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:33,477 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:35,022 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6167.700000 2021-11-21 23:58:35,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:35,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:36,494 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6167.700000 2021-11-21 23:58:36,502 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:36,503 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:37,977 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6167.700000 2021-11-21 23:58:37,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:37,986 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:39,552 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6167.700000 2021-11-21 23:58:39,561 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:39,562 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:41,099 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6167.700000 2021-11-21 23:58:41,108 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:41,108 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:42,644 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6332.100000 2021-11-21 23:58:42,651 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:42,651 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:44,157 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.200000 2021-11-21 23:58:44,164 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:44,164 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:45,706 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.200000 2021-11-21 23:58:45,713 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:45,713 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:47,207 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.200000 2021-11-21 23:58:47,216 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:47,217 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:48,736 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.200000 2021-11-21 23:58:48,742 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:48,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:50,240 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.200000 2021-11-21 23:58:50,246 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:50,246 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:51,711 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.900000 2021-11-21 23:58:51,717 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:51,719 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:53,229 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.900000 2021-11-21 23:58:53,234 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:53,236 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:54,759 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6379.500000 2021-11-21 23:58:54,766 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:54,766 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:56,267 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6379.500000 2021-11-21 23:58:56,278 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:56,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:57,733 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6379.500000 2021-11-21 23:58:57,740 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:57,740 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:58:59,204 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6379.500000 2021-11-21 23:58:59,210 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:58:59,211 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:00,690 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6379.500000 2021-11-21 23:59:00,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:00,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:02,200 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6585.500000 2021-11-21 23:59:02,206 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:02,206 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:03,752 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:03,756 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:03,756 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:05,233 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:05,239 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:05,240 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:06,756 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:06,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:06,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:08,260 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:08,269 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:08,270 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:09,769 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:09,775 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:09,776 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:11,272 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6734.200000 2021-11-21 23:59:11,278 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:11,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:12,721 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6675.700000 2021-11-21 23:59:12,729 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:12,730 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:14,289 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6587.400000 2021-11-21 23:59:14,296 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:14,298 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:15,821 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6587.400000 2021-11-21 23:59:15,828 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:15,829 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:17,331 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6587.400000 2021-11-21 23:59:17,336 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:17,336 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:18,848 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6587.400000 2021-11-21 23:59:18,858 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:18,859 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:20,510 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6587.400000 2021-11-21 23:59:20,517 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:20,519 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:22,025 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6250.300000 2021-11-21 23:59:22,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:22,030 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:23,520 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:23,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:23,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:25,049 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:25,055 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:25,055 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:26,661 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:26,665 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:26,667 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:28,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:28,128 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:28,128 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:29,559 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:29,565 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:29,565 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:31,059 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.000000 2021-11-21 23:59:31,066 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:31,068 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:32,609 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5844.300000 2021-11-21 23:59:32,617 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:32,618 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:34,063 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6009.800000 2021-11-21 23:59:34,069 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:34,069 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:35,529 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6009.800000 2021-11-21 23:59:35,536 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:35,536 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:37,055 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6009.800000 2021-11-21 23:59:37,061 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:37,061 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:38,575 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6009.800000 2021-11-21 23:59:38,582 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:38,582 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:39,713 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03' completed 2021-11-21 23:59:39,714 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04' started 2021-11-21 23:59:39,743 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03' completed 2021-11-21 23:59:39,744 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04' started 2021-11-21 23:59:39,755 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03' completed 2021-11-21 23:59:39,756 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04' started 2021-11-21 23:59:39,765 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03' completed 2021-11-21 23:59:39,766 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04' started 2021-11-21 23:59:40,046 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6009.800000 2021-11-21 23:59:40,052 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:40,052 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:40,131 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03' completed 2021-11-21 23:59:40,131 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04' started 2021-11-21 23:59:40,198 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03' completed 2021-11-21 23:59:40,200 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04' started 2021-11-21 23:59:40,217 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03' completed 2021-11-21 23:59:40,217 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04' started 2021-11-21 23:59:40,219 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03 are 26400 2021-11-21 23:59:40,219 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1056000 to 1082400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:59:40,220 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:59:40,234 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03' completed 2021-11-21 23:59:40,236 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04' started 2021-11-21 23:59:40,296 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03' completed 2021-11-21 23:59:40,296 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04' started 2021-11-21 23:59:40,316 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03' completed 2021-11-21 23:59:40,318 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04' started 2021-11-21 23:59:40,318 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03 are 26400 2021-11-21 23:59:40,319 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1056000 to 1082400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:59:40,319 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:59:40,323 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04' completed 2021-11-21 23:59:40,323 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04' started 2021-11-21 23:59:40,335 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03' completed 2021-11-21 23:59:40,336 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04' started 2021-11-21 23:59:40,348 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03' completed 2021-11-21 23:59:40,348 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04' started 2021-11-21 23:59:40,359 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03' completed 2021-11-21 23:59:40,359 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04' started 2021-11-21 23:59:40,361 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03' completed 2021-11-21 23:59:40,361 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04' started 2021-11-21 23:59:40,384 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04' completed 2021-11-21 23:59:40,384 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04' started 2021-11-21 23:59:40,392 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03' completed 2021-11-21 23:59:40,394 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04' started 2021-11-21 23:59:40,496 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04' completed 2021-11-21 23:59:40,497 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04' started 2021-11-21 23:59:40,526 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03' completed 2021-11-21 23:59:40,528 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04' started 2021-11-21 23:59:40,528 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03 are 26400 2021-11-21 23:59:40,529 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1056000 to 1082400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03 2021-11-21 23:59:40,529 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,535 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03' completed 2021-11-21 23:59:40,535 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04' started 2021-11-21 23:59:40,540 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03' completed 2021-11-21 23:59:40,540 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04' started 2021-11-21 23:59:40,744 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03' completed 2021-11-21 23:59:40,744 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04' started 2021-11-21 23:59:40,785 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03' completed 2021-11-21 23:59:40,786 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04' started 2021-11-21 23:59:40,793 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03' completed 2021-11-21 23:59:40,795 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04' started 2021-11-21 23:59:40,819 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04' completed 2021-11-21 23:59:40,821 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04' started 2021-11-21 23:59:40,890 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03' completed 2021-11-21 23:59:40,891 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04' started 2021-11-21 23:59:40,891 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03 are 26400 2021-11-21 23:59:40,891 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1082400 to 1108800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,892 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,892 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03 are 26400 2021-11-21 23:59:40,894 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1082400 to 1108800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,894 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,894 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04' completed 2021-11-21 23:59:40,894 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03 are 26400 2021-11-21 23:59:40,895 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04' started 2021-11-21 23:59:40,895 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1082400 to 1108800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03 2021-11-21 23:59:40,897 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,898 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03 are 26400 2021-11-21 23:59:40,898 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1108800 to 1135200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,898 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,900 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03 are 26400 2021-11-21 23:59:40,901 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1108800 to 1135200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,901 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,901 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03 are 26400 2021-11-21 23:59:40,903 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1108800 to 1135200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03 2021-11-21 23:59:40,904 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,904 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03 are 26400 2021-11-21 23:59:40,905 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1135200 to 1161600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,905 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,907 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03 are 26400 2021-11-21 23:59:40,907 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1135200 to 1161600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,907 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,908 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03 are 26400 2021-11-21 23:59:40,908 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1135200 to 1161600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03 2021-11-21 23:59:40,910 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,910 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03 are 26400 2021-11-21 23:59:40,911 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1161600 to 1188000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,911 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,911 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03 are 26400 2021-11-21 23:59:40,913 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1161600 to 1188000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,913 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,914 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03 are 26400 2021-11-21 23:59:40,914 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1161600 to 1188000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03 2021-11-21 23:59:40,914 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,915 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03 are 26400 2021-11-21 23:59:40,917 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1188000 to 1214400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,917 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,917 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03 are 26400 2021-11-21 23:59:40,918 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1188000 to 1214400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,918 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,920 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03 are 26400 2021-11-21 23:59:40,921 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1188000 to 1214400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03 2021-11-21 23:59:40,921 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,921 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03 are 26400 2021-11-21 23:59:40,921 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1214400 to 1240800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,923 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,924 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03 are 26400 2021-11-21 23:59:40,924 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1214400 to 1240800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,924 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,926 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03 are 26400 2021-11-21 23:59:40,927 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1214400 to 1240800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03 2021-11-21 23:59:40,927 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03 2021-11-21 23:59:40,927 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03 are 26400 2021-11-21 23:59:40,927 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1240800 to 1267200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03 2021-11-21 23:59:40,928 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:59:40,928 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04 are 26400 2021-11-21 23:59:40,930 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1240800 to 1267200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:59:40,930 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:59:41,073 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04' completed 2021-11-21 23:59:41,075 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04' started 2021-11-21 23:59:41,075 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04 are 26400 2021-11-21 23:59:41,075 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1240800 to 1267200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04 2021-11-21 23:59:41,075 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,076 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04 are 26400 2021-11-21 23:59:41,076 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1267200 to 1293600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,078 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,078 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04 are 26400 2021-11-21 23:59:41,078 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1267200 to 1293600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,078 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:59:41,079 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04 are 26400 2021-11-21 23:59:41,081 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1293600 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:59:41,081 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,082 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04 are 26400 2021-11-21 23:59:41,082 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1267200 to 1293600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04 2021-11-21 23:59:41,082 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-21 23:59:41,528 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6188.300000 2021-11-21 23:59:41,532 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:41,533 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:43,022 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6188.300000 2021-11-21 23:59:43,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:43,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:44,592 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6260.200000 2021-11-21 23:59:44,596 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:44,598 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:46,233 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6260.200000 2021-11-21 23:59:46,240 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:46,242 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:47,803 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6260.200000 2021-11-21 23:59:47,809 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:47,811 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:49,312 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6260.200000 2021-11-21 23:59:49,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:49,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:50,848 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6260.200000 2021-11-21 23:59:50,854 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:50,855 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:52,423 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6034.400000 2021-11-21 23:59:52,430 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:52,430 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:53,973 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5842.700000 2021-11-21 23:59:53,980 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:53,980 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:55,476 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5842.700000 2021-11-21 23:59:55,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:55,484 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:56,979 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5842.700000 2021-11-21 23:59:56,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:56,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-21 23:59:58,479 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5842.700000 2021-11-21 23:59:58,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-21 23:59:58,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:00,029 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5842.700000 2021-11-22 00:00:00,036 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:00,038 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:01,569 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5830.300000 2021-11-22 00:00:01,579 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:01,581 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:03,125 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5830.300000 2021-11-22 00:00:03,134 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:03,135 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:04,716 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5818.700000 2021-11-22 00:00:04,721 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:04,721 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:06,276 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5818.700000 2021-11-22 00:00:06,282 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:06,282 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:07,733 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5818.700000 2021-11-22 00:00:07,746 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:07,746 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:09,266 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5818.700000 2021-11-22 00:00:09,272 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:09,273 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:10,766 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5818.700000 2021-11-22 00:00:10,773 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:10,775 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:12,364 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5853.000000 2021-11-22 00:00:12,371 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:12,371 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:13,891 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5975.500000 2021-11-22 00:00:13,897 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:13,898 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:15,358 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5975.500000 2021-11-22 00:00:15,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:15,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:16,923 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5975.500000 2021-11-22 00:00:16,928 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:16,928 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:18,496 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5975.500000 2021-11-22 00:00:18,503 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:18,503 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:20,059 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5975.500000 2021-11-22 00:00:20,065 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:20,066 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:21,615 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6153.700000 2021-11-22 00:00:21,621 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:21,621 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:23,124 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6153.700000 2021-11-22 00:00:23,145 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:23,147 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:24,598 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.400000 2021-11-22 00:00:24,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:24,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:26,107 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.400000 2021-11-22 00:00:26,112 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:26,112 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:27,625 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.400000 2021-11-22 00:00:27,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:27,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:29,117 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.400000 2021-11-22 00:00:29,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:29,124 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:30,611 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6244.400000 2021-11-22 00:00:30,618 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:30,619 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:32,190 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6361.400000 2021-11-22 00:00:32,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:32,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:33,746 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6476.900000 2021-11-22 00:00:33,753 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:33,753 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:35,285 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6476.900000 2021-11-22 00:00:35,292 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:35,292 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:36,851 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6476.900000 2021-11-22 00:00:36,858 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:36,858 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:38,352 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6476.900000 2021-11-22 00:00:38,359 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:38,359 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:40,075 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6476.900000 2021-11-22 00:00:40,101 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:40,101 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:41,536 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6468.900000 2021-11-22 00:00:41,542 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:41,543 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:43,102 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6468.900000 2021-11-22 00:00:43,108 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:43,109 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:44,618 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-22 00:00:44,625 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:44,625 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:46,105 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-22 00:00:46,111 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:46,111 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:47,680 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-22 00:00:47,687 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:47,688 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:49,236 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-22 00:00:49,242 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:49,243 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:50,744 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.100000 2021-11-22 00:00:50,753 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:50,753 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:52,276 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6541.800000 2021-11-22 00:00:52,280 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:52,282 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:53,786 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:00:53,792 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:53,792 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:55,361 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:00:55,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:55,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:56,802 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:00:56,808 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:56,809 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:58,367 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:00:58,390 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:58,391 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:00:59,914 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:00:59,920 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:00:59,920 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:01,529 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6442.700000 2021-11-22 00:01:01,536 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:01,538 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:03,125 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6336.300000 2021-11-22 00:01:03,132 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:03,134 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:04,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6189.700000 2021-11-22 00:01:04,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:04,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:06,210 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6189.700000 2021-11-22 00:01:06,217 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:06,217 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:07,700 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6189.700000 2021-11-22 00:01:07,707 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:07,709 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:09,148 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6189.700000 2021-11-22 00:01:09,155 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:09,155 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:10,641 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6189.700000 2021-11-22 00:01:10,647 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:10,647 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:12,161 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6168.200000 2021-11-22 00:01:12,170 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:12,171 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:13,684 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:13,693 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:13,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:15,163 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:15,170 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:15,171 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:16,664 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:16,671 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:16,673 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:18,234 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:18,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:18,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:19,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:19,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:19,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:21,263 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6246.900000 2021-11-22 00:01:21,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:21,269 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:22,736 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6343.800000 2021-11-22 00:01:22,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:22,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:24,180 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6342.400000 2021-11-22 00:01:24,187 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:24,187 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:25,628 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6342.400000 2021-11-22 00:01:25,634 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:25,634 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:27,197 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6342.400000 2021-11-22 00:01:27,203 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:27,203 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:28,665 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6342.400000 2021-11-22 00:01:28,674 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:28,676 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:30,177 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6342.400000 2021-11-22 00:01:30,184 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:30,184 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:31,651 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.800000 2021-11-22 00:01:31,658 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:31,658 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:33,134 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.800000 2021-11-22 00:01:33,141 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:33,142 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:34,581 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6280.000000 2021-11-22 00:01:34,586 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:34,586 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:36,056 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6280.000000 2021-11-22 00:01:36,063 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:36,063 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:37,596 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6280.000000 2021-11-22 00:01:37,602 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:37,604 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:37,703 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04' completed 2021-11-22 00:01:37,703 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04' started 2021-11-22 00:01:38,338 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04' completed 2021-11-22 00:01:38,338 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04' started 2021-11-22 00:01:38,388 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04' completed 2021-11-22 00:01:38,388 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04' started 2021-11-22 00:01:38,437 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04' completed 2021-11-22 00:01:38,438 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04' started 2021-11-22 00:01:38,438 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04 are 26400 2021-11-22 00:01:38,440 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1293600 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-22 00:01:38,440 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,440 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04' completed 2021-11-22 00:01:38,441 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04' started 2021-11-22 00:01:38,440 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04 are 26400 2021-11-22 00:01:38,443 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1346400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,444 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-22 00:01:38,476 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04' completed 2021-11-22 00:01:38,477 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04' started 2021-11-22 00:01:38,477 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04 are 26400 2021-11-22 00:01:38,480 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1293600 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04 2021-11-22 00:01:38,480 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,561 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04' completed 2021-11-22 00:01:38,562 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04' started 2021-11-22 00:01:38,562 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04 are 26400 2021-11-22 00:01:38,562 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1346400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,563 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:38,563 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04 are 26400 2021-11-22 00:01:38,565 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1346400 to 1372800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:38,565 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,565 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04 are 26400 2021-11-22 00:01:38,566 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1346400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04 2021-11-22 00:01:38,566 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:38,806 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04' completed 2021-11-22 00:01:38,808 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04' started 2021-11-22 00:01:38,936 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04' completed 2021-11-22 00:01:38,937 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04' started 2021-11-22 00:01:38,986 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04' completed 2021-11-22 00:01:38,987 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04' started 2021-11-22 00:01:38,996 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04' completed 2021-11-22 00:01:38,997 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04' started 2021-11-22 00:01:39,042 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04' completed 2021-11-22 00:01:39,043 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05' started 2021-11-22 00:01:39,052 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04' completed 2021-11-22 00:01:39,052 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05' started 2021-11-22 00:01:39,063 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04' completed 2021-11-22 00:01:39,065 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05' started 2021-11-22 00:01:39,148 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6280.000000 2021-11-22 00:01:39,180 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:39,181 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:39,552 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04' completed 2021-11-22 00:01:39,553 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05' started 2021-11-22 00:01:39,709 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04' completed 2021-11-22 00:01:39,710 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05' started 2021-11-22 00:01:39,710 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04 are 26400 2021-11-22 00:01:39,710 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1346400 to 1372800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:39,711 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:39,711 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04 are 26400 2021-11-22 00:01:39,713 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1346400 to 1372800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04 2021-11-22 00:01:39,713 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,749 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04' completed 2021-11-22 00:01:39,750 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05' started 2021-11-22 00:01:39,766 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04' completed 2021-11-22 00:01:39,767 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05' started 2021-11-22 00:01:39,767 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04 are 26400 2021-11-22 00:01:39,769 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1372800 to 1399200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,769 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,770 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04 are 26400 2021-11-22 00:01:39,770 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1372800 to 1399200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,772 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,811 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04' completed 2021-11-22 00:01:39,812 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05' started 2021-11-22 00:01:39,823 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04' completed 2021-11-22 00:01:39,825 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05' started 2021-11-22 00:01:39,872 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04' completed 2021-11-22 00:01:39,874 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05' started 2021-11-22 00:01:39,881 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04' completed 2021-11-22 00:01:39,882 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05' started 2021-11-22 00:01:39,884 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04' completed 2021-11-22 00:01:39,885 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05' started 2021-11-22 00:01:39,948 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04' completed 2021-11-22 00:01:39,950 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05' started 2021-11-22 00:01:39,950 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04 are 26400 2021-11-22 00:01:39,950 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1399200 to 1425600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,951 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,953 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04 are 26400 2021-11-22 00:01:39,953 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1372800 to 1399200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04 2021-11-22 00:01:39,954 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,954 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04 are 26400 2021-11-22 00:01:39,956 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1399200 to 1425600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,957 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,959 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04 are 26400 2021-11-22 00:01:39,960 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1425600 to 1452000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,960 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,960 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04 are 26400 2021-11-22 00:01:39,961 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1399200 to 1425600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04 2021-11-22 00:01:39,963 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,963 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04 are 26400 2021-11-22 00:01:39,963 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1425600 to 1452000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,964 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:39,966 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04 are 26400 2021-11-22 00:01:39,967 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1452000 to 1478400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:39,967 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,967 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04 are 26400 2021-11-22 00:01:39,969 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1425600 to 1452000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04 2021-11-22 00:01:39,970 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:39,994 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04' completed 2021-11-22 00:01:39,996 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11' started 2021-11-22 00:01:40,233 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04' completed 2021-11-22 00:01:40,233 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11' started 2021-11-22 00:01:40,480 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04' completed 2021-11-22 00:01:40,483 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11' started 2021-11-22 00:01:40,483 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04 are 26400 2021-11-22 00:01:40,483 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1452000 to 1478400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:40,484 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,486 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04 are 26400 2021-11-22 00:01:40,486 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1478400 to 1504800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,486 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:40,487 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04 are 26400 2021-11-22 00:01:40,489 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1452000 to 1478400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04 2021-11-22 00:01:40,489 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,490 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04 are 26400 2021-11-22 00:01:40,490 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1478400 to 1504800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,492 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,713 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6280.000000 2021-11-22 00:01:40,720 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:40,720 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:40,783 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04' completed 2021-11-22 00:01:40,785 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11' started 2021-11-22 00:01:40,786 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04 are 26400 2021-11-22 00:01:40,786 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1504800 to 1531200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,788 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,788 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04 are 26400 2021-11-22 00:01:40,789 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1478400 to 1504800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04 2021-11-22 00:01:40,789 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,790 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04 are 26400 2021-11-22 00:01:40,790 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1504800 to 1531200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,792 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,792 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04 are 26400 2021-11-22 00:01:40,793 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1504800 to 1531200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04 2021-11-22 00:01:40,793 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:01:40,795 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04 are 26400 2021-11-22 00:01:40,796 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1531200 to 1557600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:01:40,796 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:01:40,796 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04 are 26400 2021-11-22 00:01:40,798 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1531200 to 1557600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:01:40,799 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:01:42,266 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6253.800000 2021-11-22 00:01:42,273 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:42,273 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:43,720 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:43,726 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:43,726 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:45,255 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:45,260 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:45,262 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:46,793 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:46,801 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:46,801 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:48,279 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:48,283 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:48,285 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:49,753 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:49,759 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:49,760 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:51,380 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6024.300000 2021-11-22 00:01:51,384 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:51,385 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:52,887 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6013.000000 2021-11-22 00:01:52,894 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:52,894 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:54,368 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6147.500000 2021-11-22 00:01:54,374 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:54,374 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:55,992 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6147.500000 2021-11-22 00:01:55,997 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:55,999 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:57,586 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6147.500000 2021-11-22 00:01:57,594 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:57,595 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:01:59,118 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6147.500000 2021-11-22 00:01:59,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:01:59,124 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:00,615 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6147.500000 2021-11-22 00:02:00,621 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:00,621 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:02,098 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6248.900000 2021-11-22 00:02:02,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:02,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:03,569 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:03,575 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:03,576 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:05,086 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:05,094 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:05,095 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:06,563 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:06,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:06,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:08,069 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:08,075 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:08,076 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:09,607 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:09,612 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:09,614 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:11,062 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6392.600000 2021-11-22 00:02:11,069 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:11,069 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:12,611 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6317.900000 2021-11-22 00:02:12,618 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:12,618 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:14,161 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6200.600000 2021-11-22 00:02:14,167 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:14,167 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:15,654 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6200.600000 2021-11-22 00:02:15,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:15,661 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:17,210 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6200.600000 2021-11-22 00:02:17,217 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:17,217 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:18,756 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6200.600000 2021-11-22 00:02:18,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:18,765 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:20,302 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6200.600000 2021-11-22 00:02:20,309 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:20,309 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:21,857 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6197.900000 2021-11-22 00:02:21,862 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:21,864 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:23,411 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6197.900000 2021-11-22 00:02:23,417 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:23,418 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:24,898 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6211.000000 2021-11-22 00:02:24,905 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:24,905 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:26,509 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6211.000000 2021-11-22 00:02:26,515 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:26,515 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:27,979 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6211.000000 2021-11-22 00:02:27,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:27,986 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:29,457 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6211.000000 2021-11-22 00:02:29,464 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:29,464 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:31,020 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6211.000000 2021-11-22 00:02:31,026 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:31,026 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:32,559 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6170.800000 2021-11-22 00:02:32,565 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:32,566 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:34,193 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6036.600000 2021-11-22 00:02:34,198 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:34,200 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:35,786 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6036.600000 2021-11-22 00:02:35,792 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:35,793 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:37,313 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6036.600000 2021-11-22 00:02:37,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:37,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:38,904 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6036.600000 2021-11-22 00:02:38,911 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:38,911 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:40,423 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6036.600000 2021-11-22 00:02:40,428 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:40,430 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:42,022 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6038.200000 2021-11-22 00:02:42,028 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:42,028 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:43,519 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:43,525 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:43,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:45,002 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:45,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:45,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:46,499 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:46,503 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:46,505 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:48,049 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:48,055 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:48,055 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:49,575 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:49,579 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:49,581 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:51,105 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6050.500000 2021-11-22 00:02:51,111 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:51,111 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:52,611 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6012.500000 2021-11-22 00:02:52,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:52,617 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:54,145 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5992.400000 2021-11-22 00:02:54,153 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:54,154 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:55,721 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5992.400000 2021-11-22 00:02:55,726 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:55,727 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:57,303 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5992.400000 2021-11-22 00:02:57,309 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:57,309 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:02:58,806 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5992.400000 2021-11-22 00:02:58,812 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:02:58,812 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:00,312 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5992.400000 2021-11-22 00:03:00,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:00,319 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:01,834 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5926.600000 2021-11-22 00:03:01,839 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:01,841 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:03,371 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5926.600000 2021-11-22 00:03:03,378 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:03,378 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:04,882 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5972.900000 2021-11-22 00:03:04,888 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:04,888 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:06,381 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5972.900000 2021-11-22 00:03:06,390 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:06,391 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:07,894 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5972.900000 2021-11-22 00:03:07,900 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:07,900 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:09,414 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5972.900000 2021-11-22 00:03:09,421 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:09,421 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:10,944 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5972.900000 2021-11-22 00:03:10,950 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:10,950 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:12,440 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6141.500000 2021-11-22 00:03:12,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:12,446 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:13,948 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:13,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:13,954 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:15,428 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:15,436 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:15,437 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:16,979 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:16,983 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:16,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:18,414 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:18,421 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:18,421 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:19,979 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:19,984 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:19,986 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:21,539 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6276.300000 2021-11-22 00:03:21,548 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:21,548 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:23,217 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6269.900000 2021-11-22 00:03:23,224 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:23,226 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:24,694 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6204.500000 2021-11-22 00:03:24,701 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:24,703 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:26,198 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6204.500000 2021-11-22 00:03:26,206 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:26,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:27,736 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6204.500000 2021-11-22 00:03:27,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:27,744 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:29,221 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6204.500000 2021-11-22 00:03:29,227 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:29,227 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:30,737 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6204.500000 2021-11-22 00:03:30,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:30,744 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:32,282 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6203.500000 2021-11-22 00:03:32,288 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:32,288 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:33,299 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05' completed 2021-11-22 00:03:33,299 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12' started 2021-11-22 00:03:33,822 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04' completed 2021-11-22 00:03:33,823 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12' started 2021-11-22 00:03:33,865 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04' completed 2021-11-22 00:03:33,867 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12' started 2021-11-22 00:03:33,892 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04' completed 2021-11-22 00:03:33,894 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12' started 2021-11-22 00:03:33,911 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:33,917 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:33,917 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:34,066 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04' completed 2021-11-22 00:03:34,068 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12' started 2021-11-22 00:03:34,075 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05' completed 2021-11-22 00:03:34,076 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12' started 2021-11-22 00:03:34,105 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05' completed 2021-11-22 00:03:34,105 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12' started 2021-11-22 00:03:34,142 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04' completed 2021-11-22 00:03:34,144 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12' started 2021-11-22 00:03:34,157 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04' completed 2021-11-22 00:03:34,158 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12' started 2021-11-22 00:03:34,160 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04 are 26400 2021-11-22 00:03:34,160 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1531200 to 1557600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04 2021-11-22 00:03:34,161 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:34,223 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04' completed 2021-11-22 00:03:34,224 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12' started 2021-11-22 00:03:34,309 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04' completed 2021-11-22 00:03:34,311 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12' started 2021-11-22 00:03:34,477 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05' completed 2021-11-22 00:03:34,479 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12' started 2021-11-22 00:03:34,552 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05' completed 2021-11-22 00:03:34,555 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12' started 2021-11-22 00:03:34,617 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05' completed 2021-11-22 00:03:34,618 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12' started 2021-11-22 00:03:34,658 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05' completed 2021-11-22 00:03:34,660 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12' started 2021-11-22 00:03:34,674 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05' completed 2021-11-22 00:03:34,674 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12' started 2021-11-22 00:03:34,719 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05' completed 2021-11-22 00:03:34,720 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12' started 2021-11-22 00:03:34,756 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04' completed 2021-11-22 00:03:34,757 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12' started 2021-11-22 00:03:34,770 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05' completed 2021-11-22 00:03:34,772 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12' started 2021-11-22 00:03:34,783 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05' completed 2021-11-22 00:03:34,785 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12' started 2021-11-22 00:03:34,789 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04' completed 2021-11-22 00:03:34,790 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12' started 2021-11-22 00:03:35,167 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05' completed 2021-11-22 00:03:35,167 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' started 2021-11-22 00:03:35,221 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05' completed 2021-11-22 00:03:35,223 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12' started 2021-11-22 00:03:35,417 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:35,424 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:35,424 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:35,635 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04' completed 2021-11-22 00:03:35,637 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04 are 26400 2021-11-22 00:03:35,637 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' started 2021-11-22 00:03:35,637 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1557600 to 1584000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:35,638 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:35,638 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04 are 26400 2021-11-22 00:03:35,638 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1557600 to 1584000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:35,640 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:35,640 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04 are 26400 2021-11-22 00:03:35,641 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1557600 to 1584000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04 2021-11-22 00:03:35,641 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04 2021-11-22 00:03:35,642 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04 are 26400 2021-11-22 00:03:35,642 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1056000 to 1082400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04 2021-11-22 00:03:35,644 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04 2021-11-22 00:03:35,644 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04 are 26400 2021-11-22 00:03:35,644 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1082400 to 1108800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04 2021-11-22 00:03:35,644 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04 2021-11-22 00:03:35,645 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04 are 26400 2021-11-22 00:03:35,647 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1108800 to 1135200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04 2021-11-22 00:03:35,647 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04 2021-11-22 00:03:35,648 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04 are 26400 2021-11-22 00:03:35,648 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1135200 to 1161600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04 2021-11-22 00:03:35,648 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04 2021-11-22 00:03:35,650 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04 are 26400 2021-11-22 00:03:35,650 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1161600 to 1188000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04 2021-11-22 00:03:35,651 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04 2021-11-22 00:03:35,651 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04 are 26400 2021-11-22 00:03:35,651 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1188000 to 1214400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04 2021-11-22 00:03:35,653 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04 2021-11-22 00:03:35,653 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04 are 26400 2021-11-22 00:03:35,654 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1214400 to 1240800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04 2021-11-22 00:03:35,654 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05 2021-11-22 00:03:35,654 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05 are 26400 2021-11-22 00:03:35,655 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1240800 to 1267200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05 2021-11-22 00:03:35,657 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05 2021-11-22 00:03:35,657 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05 are 26400 2021-11-22 00:03:35,657 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1267200 to 1293600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05 2021-11-22 00:03:35,657 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05 2021-11-22 00:03:35,658 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05 are 26400 2021-11-22 00:03:35,660 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1293600 to 1320000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05 2021-11-22 00:03:35,660 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05 2021-11-22 00:03:35,661 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05 are 26400 2021-11-22 00:03:35,661 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1320000 to 1346400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05 2021-11-22 00:03:35,661 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05 2021-11-22 00:03:35,663 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05 are 26400 2021-11-22 00:03:35,663 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1346400 to 1372800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05 2021-11-22 00:03:35,664 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05 2021-11-22 00:03:35,664 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05 are 26400 2021-11-22 00:03:35,664 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1372800 to 1399200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05 2021-11-22 00:03:35,665 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05 2021-11-22 00:03:35,665 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05 are 26400 2021-11-22 00:03:35,667 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1399200 to 1425600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05 2021-11-22 00:03:35,667 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05 2021-11-22 00:03:35,667 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05 are 26400 2021-11-22 00:03:35,668 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1425600 to 1452000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05 2021-11-22 00:03:35,670 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05 2021-11-22 00:03:35,670 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05 are 26400 2021-11-22 00:03:35,671 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1452000 to 1478400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05 2021-11-22 00:03:35,671 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05 2021-11-22 00:03:35,671 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05 are 26400 2021-11-22 00:03:35,673 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1478400 to 1504800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05 2021-11-22 00:03:35,674 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05 2021-11-22 00:03:35,674 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05 are 26400 2021-11-22 00:03:35,674 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1504800 to 1531200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05 2021-11-22 00:03:35,676 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05 2021-11-22 00:03:35,676 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05 are 26400 2021-11-22 00:03:35,677 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1531200 to 1557600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05 2021-11-22 00:03:35,677 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05 2021-11-22 00:03:35,677 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05 are 26400 2021-11-22 00:03:35,678 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 1557600 to 1584000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05 2021-11-22 00:03:35,678 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11 2021-11-22 00:03:36,938 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:36,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:36,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:38,414 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:38,423 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:38,424 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:39,948 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:39,956 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:39,956 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:41,411 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6242.300000 2021-11-22 00:03:41,417 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:41,418 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:42,901 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5915.000000 2021-11-22 00:03:42,908 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:42,908 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:44,415 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5529.400000 2021-11-22 00:03:44,421 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:44,423 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:45,943 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5529.400000 2021-11-22 00:03:45,948 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:45,950 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:47,444 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5529.400000 2021-11-22 00:03:47,450 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:47,450 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:48,898 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5529.400000 2021-11-22 00:03:48,904 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:48,904 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:50,346 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5529.400000 2021-11-22 00:03:50,351 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:50,351 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:51,792 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5656.900000 2021-11-22 00:03:51,796 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:51,798 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:53,250 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5656.900000 2021-11-22 00:03:53,256 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:53,257 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:54,734 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5806.900000 2021-11-22 00:03:54,740 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:54,742 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:56,260 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5806.900000 2021-11-22 00:03:56,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:56,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:57,730 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5806.900000 2021-11-22 00:03:57,734 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:57,736 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:03:59,213 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5806.900000 2021-11-22 00:03:59,220 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:03:59,221 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:00,799 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5806.900000 2021-11-22 00:04:00,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:00,806 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:02,348 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5905.700000 2021-11-22 00:04:02,352 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:02,352 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:03,835 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:03,842 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:03,844 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:05,308 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:05,312 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:05,312 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:06,834 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:06,838 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:06,839 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:08,279 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:08,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:08,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:09,822 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:09,828 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:09,828 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:10,957 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11' completed 2021-11-22 00:04:10,960 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12' started 2021-11-22 00:04:11,331 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6031.500000 2021-11-22 00:04:11,338 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:11,338 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:11,417 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11' completed 2021-11-22 00:04:11,418 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' started 2021-11-22 00:04:11,448 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11' completed 2021-11-22 00:04:11,450 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12' started 2021-11-22 00:04:12,084 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11' completed 2021-11-22 00:04:12,084 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' started 2021-11-22 00:04:12,085 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11 are 26400 2021-11-22 00:04:12,085 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 26400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11 2021-11-22 00:04:12,085 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11 2021-11-22 00:04:12,086 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11 are 26400 2021-11-22 00:04:12,086 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 26400 to 52800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11 2021-11-22 00:04:12,088 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11 2021-11-22 00:04:12,088 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11 are 26400 2021-11-22 00:04:12,088 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 52800 to 79200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11 2021-11-22 00:04:12,088 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11 2021-11-22 00:04:12,089 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11 are 26400 2021-11-22 00:04:12,089 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 79200 to 105600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11 2021-11-22 00:04:12,091 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:04:12,967 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5998.200000 2021-11-22 00:04:12,971 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:12,973 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:14,479 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5920.600000 2021-11-22 00:04:14,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:14,484 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:16,042 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5920.600000 2021-11-22 00:04:16,049 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:16,049 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:17,644 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5920.600000 2021-11-22 00:04:17,651 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:17,651 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:19,131 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5920.600000 2021-11-22 00:04:19,138 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:19,138 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:20,596 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5920.600000 2021-11-22 00:04:20,602 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:20,604 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:22,117 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5884.200000 2021-11-22 00:04:22,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:22,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:23,611 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:23,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:23,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:25,148 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:25,154 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:25,154 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:26,654 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:26,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:26,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:28,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:28,121 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:28,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:29,653 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:29,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:29,661 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:31,135 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5900.400000 2021-11-22 00:04:31,142 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:31,144 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:32,680 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5934.800000 2021-11-22 00:04:32,687 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:32,687 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:34,263 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5873.700000 2021-11-22 00:04:34,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:34,269 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:35,726 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5873.700000 2021-11-22 00:04:35,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:35,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:37,253 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5873.700000 2021-11-22 00:04:37,257 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:37,259 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:38,798 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5873.700000 2021-11-22 00:04:38,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:38,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:40,332 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5873.700000 2021-11-22 00:04:40,339 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:40,342 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:41,778 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.100000 2021-11-22 00:04:41,783 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:41,785 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:43,309 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5846.100000 2021-11-22 00:04:43,315 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:43,316 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:44,815 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5887.900000 2021-11-22 00:04:44,819 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:44,821 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:46,289 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5887.900000 2021-11-22 00:04:46,295 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:46,296 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:47,775 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5887.900000 2021-11-22 00:04:47,782 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:47,782 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:49,345 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5887.900000 2021-11-22 00:04:49,351 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:49,352 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:50,829 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5887.900000 2021-11-22 00:04:50,836 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:50,838 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:52,398 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5919.000000 2021-11-22 00:04:52,403 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:52,404 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:53,895 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:04:53,901 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:53,903 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:55,405 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:04:55,411 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:55,413 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:56,901 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:04:56,907 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:56,907 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:58,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:04:58,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:58,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:04:59,970 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:04:59,977 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:04:59,979 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:01,604 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 6016.600000 2021-11-22 00:05:01,611 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:01,611 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:03,378 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5927.400000 2021-11-22 00:05:03,384 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:03,385 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:04,923 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5703.700000 2021-11-22 00:05:04,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:04,931 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:06,427 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5703.700000 2021-11-22 00:05:06,434 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:06,434 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:07,928 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5703.700000 2021-11-22 00:05:07,936 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:07,937 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:09,450 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5703.700000 2021-11-22 00:05:09,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:09,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:11,026 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5703.700000 2021-11-22 00:05:11,035 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:11,036 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:12,598 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5547.900000 2021-11-22 00:05:12,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:12,605 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:14,184 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.300000 2021-11-22 00:05:14,193 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:14,193 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:15,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.300000 2021-11-22 00:05:15,693 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:15,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:17,194 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.300000 2021-11-22 00:05:17,201 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:17,203 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:18,680 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.300000 2021-11-22 00:05:18,687 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:18,687 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:20,191 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.300000 2021-11-22 00:05:20,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:20,198 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:21,723 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5346.400000 2021-11-22 00:05:21,732 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:21,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:23,191 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5346.400000 2021-11-22 00:05:23,206 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:23,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:24,693 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5235.900000 2021-11-22 00:05:24,698 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:24,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:26,299 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5235.900000 2021-11-22 00:05:26,305 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:26,306 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:27,819 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5235.900000 2021-11-22 00:05:27,825 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:27,825 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:29,371 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5235.900000 2021-11-22 00:05:29,380 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:29,381 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:30,946 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5235.900000 2021-11-22 00:05:30,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:30,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:32,476 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4883.500000 2021-11-22 00:05:32,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:32,484 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:33,970 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4560.500000 2021-11-22 00:05:33,977 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:33,979 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:35,641 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4560.500000 2021-11-22 00:05:35,654 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:35,655 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:37,315 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4560.500000 2021-11-22 00:05:37,326 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:37,328 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:38,848 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4560.500000 2021-11-22 00:05:38,854 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:38,855 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:40,387 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4560.500000 2021-11-22 00:05:40,394 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:40,394 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:41,987 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4539.500000 2021-11-22 00:05:41,993 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:41,994 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:43,579 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:43,586 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:43,586 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:45,171 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:45,177 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:45,177 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:46,710 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:46,717 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:46,717 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:47,042 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12' completed 2021-11-22 00:05:47,043 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12' started 2021-11-22 00:05:47,045 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12 are 26400 2021-11-22 00:05:47,045 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 105600 to 132000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:05:47,046 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:05:47,246 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12' completed 2021-11-22 00:05:47,246 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12' started 2021-11-22 00:05:47,482 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12' completed 2021-11-22 00:05:47,483 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' started 2021-11-22 00:05:48,141 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12' completed 2021-11-22 00:05:48,141 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' started 2021-11-22 00:05:48,196 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:48,201 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:48,201 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:48,440 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12' completed 2021-11-22 00:05:48,441 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12' started 2021-11-22 00:05:48,477 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12' completed 2021-11-22 00:05:48,477 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12' started 2021-11-22 00:05:48,479 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12 are 26400 2021-11-22 00:05:48,479 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 132000 to 158400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:05:48,480 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:05:48,480 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12 are 26400 2021-11-22 00:05:48,480 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 158400 to 184800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:05:48,480 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:05:48,482 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12 are 26400 2021-11-22 00:05:48,483 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 184800 to 211200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:05:48,483 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:05:48,891 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12' completed 2021-11-22 00:05:48,891 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12' started 2021-11-22 00:05:48,993 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12' completed 2021-11-22 00:05:48,993 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12' started 2021-11-22 00:05:49,397 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12' completed 2021-11-22 00:05:49,398 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12' started 2021-11-22 00:05:49,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:49,693 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:49,693 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:50,305 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12' completed 2021-11-22 00:05:50,306 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' started 2021-11-22 00:05:50,365 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12' completed 2021-11-22 00:05:50,367 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12' started 2021-11-22 00:05:50,369 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12' completed 2021-11-22 00:05:50,371 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12' started 2021-11-22 00:05:50,441 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' completed 2021-11-22 00:05:50,443 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' started 2021-11-22 00:05:50,549 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12' completed 2021-11-22 00:05:50,551 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12' started 2021-11-22 00:05:50,555 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12' completed 2021-11-22 00:05:50,555 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12' started 2021-11-22 00:05:50,602 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12' completed 2021-11-22 00:05:50,604 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' started 2021-11-22 00:05:50,634 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12' completed 2021-11-22 00:05:50,634 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12' started 2021-11-22 00:05:50,872 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12' completed 2021-11-22 00:05:50,874 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12' started 2021-11-22 00:05:50,881 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12' completed 2021-11-22 00:05:50,881 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' started 2021-11-22 00:05:51,148 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' completed 2021-11-22 00:05:51,150 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12' started 2021-11-22 00:05:51,180 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12' completed 2021-11-22 00:05:51,180 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' started 2021-11-22 00:05:51,247 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12' completed 2021-11-22 00:05:51,249 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12' started 2021-11-22 00:05:51,285 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4407.700000 2021-11-22 00:05:51,290 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:51,292 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:52,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4237.900000 2021-11-22 00:05:52,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:52,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:52,855 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12' completed 2021-11-22 00:05:52,855 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12' started 2021-11-22 00:05:53,614 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12' completed 2021-11-22 00:05:53,615 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' started 2021-11-22 00:05:53,615 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12 are 26400 2021-11-22 00:05:53,625 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 211200 to 237600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:05:53,627 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:05:53,628 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12 are 26400 2021-11-22 00:05:53,628 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 237600 to 264000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:05:53,628 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:05:53,630 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12 are 26400 2021-11-22 00:05:53,631 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 264000 to 290400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:05:53,631 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:05:53,632 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12 are 26400 2021-11-22 00:05:53,632 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 290400 to 316800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:05:53,634 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:05:53,634 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12 are 26400 2021-11-22 00:05:53,635 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 316800 to 343200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:05:53,635 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:05:53,638 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12 are 26400 2021-11-22 00:05:53,640 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 343200 to 369600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:05:53,641 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-22 00:05:53,641 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12 are 26400 2021-11-22 00:05:53,641 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 369600 to 396000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-22 00:05:53,642 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:05:53,644 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12 are 26400 2021-11-22 00:05:53,645 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 26400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:05:53,647 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-22 00:05:53,647 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12 are 26400 2021-11-22 00:05:53,648 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 396000 to 422400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-22 00:05:53,648 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:05:53,650 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12 are 26400 2021-11-22 00:05:53,650 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 26400 to 52800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:05:53,651 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-22 00:05:53,653 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12 are 26400 2021-11-22 00:05:53,654 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 422400 to 448800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-22 00:05:53,654 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-22 00:05:53,654 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12 are 26400 2021-11-22 00:05:53,655 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 448800 to 475200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-22 00:05:53,657 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:05:53,657 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12 are 26400 2021-11-22 00:05:53,657 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 52800 to 79200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:05:53,660 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:05:53,660 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12 are 26400 2021-11-22 00:05:53,661 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 79200 to 105600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:05:53,661 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12 2021-11-22 00:05:53,661 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12 are 26400 2021-11-22 00:05:53,663 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 475200 to 501600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12 2021-11-22 00:05:53,663 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12 2021-11-22 00:05:53,664 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12 are 26400 2021-11-22 00:05:53,664 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 501600 to 528000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12 2021-11-22 00:05:53,664 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:05:53,667 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12 are 26400 2021-11-22 00:05:53,667 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 105600 to 132000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:05:53,668 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:05:53,668 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 are 26400 2021-11-22 00:05:53,670 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 26400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:05:53,671 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:05:53,671 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12 are 26400 2021-11-22 00:05:53,671 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 132000 to 158400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:05:53,673 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:05:53,673 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 are 26400 2021-11-22 00:05:53,674 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 26400 to 52800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:05:53,674 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:05:54,338 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4150.000000 2021-11-22 00:05:54,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:54,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:55,931 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4150.000000 2021-11-22 00:05:55,940 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:55,940 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:57,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4150.000000 2021-11-22 00:05:57,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:57,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:05:59,069 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4150.000000 2021-11-22 00:05:59,076 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:05:59,078 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:00,581 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4150.000000 2021-11-22 00:06:00,588 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:00,589 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:02,233 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4301.900000 2021-11-22 00:06:02,240 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:02,240 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:03,719 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:03,724 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:03,726 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:05,221 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:05,227 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:05,229 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:06,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:06,691 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:06,693 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:08,252 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:08,257 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:08,259 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:09,808 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:09,815 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:09,816 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:11,311 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4530.300000 2021-11-22 00:06:11,315 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:11,316 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:12,875 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4736.700000 2021-11-22 00:06:12,882 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:12,884 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:14,434 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4870.700000 2021-11-22 00:06:14,441 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:14,443 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:15,937 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4870.700000 2021-11-22 00:06:15,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:15,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:17,523 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4870.700000 2021-11-22 00:06:17,529 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:17,529 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:19,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4870.700000 2021-11-22 00:06:19,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:19,124 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:20,638 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4870.700000 2021-11-22 00:06:20,647 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:20,648 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:22,154 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4801.500000 2021-11-22 00:06:22,161 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:22,163 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:23,670 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:23,676 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:23,677 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:25,243 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:25,250 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:25,252 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:26,752 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:26,759 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:26,759 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:28,273 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:28,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:28,280 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:29,846 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:29,854 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:29,855 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:31,421 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4721.700000 2021-11-22 00:06:31,428 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:31,430 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:32,927 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4580.100000 2021-11-22 00:06:32,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:32,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:33,426 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12' completed 2021-11-22 00:06:33,427 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12' started 2021-11-22 00:06:33,427 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12 are 26400 2021-11-22 00:06:33,428 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 158400 to 184800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:06:33,428 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:06:33,963 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' completed 2021-11-22 00:06:33,966 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12' started 2021-11-22 00:06:33,966 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 are 26400 2021-11-22 00:06:33,967 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 52800 to 79200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:06:33,967 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:06:34,440 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4612.000000 2021-11-22 00:06:34,447 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:34,448 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:35,931 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4612.000000 2021-11-22 00:06:35,938 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:35,940 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:36,045 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12' completed 2021-11-22 00:06:36,046 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13' started 2021-11-22 00:06:36,046 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12 are 26400 2021-11-22 00:06:36,048 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 184800 to 211200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:06:36,049 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:06:36,398 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' completed 2021-11-22 00:06:36,400 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13' started 2021-11-22 00:06:36,400 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 are 26400 2021-11-22 00:06:36,401 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 79200 to 105600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:06:36,401 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:06:37,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4612.000000 2021-11-22 00:06:37,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:37,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:38,944 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4612.000000 2021-11-22 00:06:38,950 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:38,950 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:40,480 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4612.000000 2021-11-22 00:06:40,484 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:40,486 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:41,914 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.400000 2021-11-22 00:06:41,921 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:41,921 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:43,434 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.400000 2021-11-22 00:06:43,441 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:43,441 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:44,956 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5313.300000 2021-11-22 00:06:44,963 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:44,963 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:46,434 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5313.300000 2021-11-22 00:06:46,443 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:46,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:47,914 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5313.300000 2021-11-22 00:06:47,923 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:47,924 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:49,456 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5313.300000 2021-11-22 00:06:49,463 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:49,463 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:50,967 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5313.300000 2021-11-22 00:06:50,976 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:50,977 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:52,490 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5059.400000 2021-11-22 00:06:52,499 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:52,500 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:54,122 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4772.400000 2021-11-22 00:06:54,131 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:54,132 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:55,625 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4772.400000 2021-11-22 00:06:55,632 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:55,634 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:57,155 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4772.400000 2021-11-22 00:06:57,163 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:57,163 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:06:58,561 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4772.400000 2021-11-22 00:06:58,566 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:06:58,568 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:00,051 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4772.400000 2021-11-22 00:07:00,061 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:00,062 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:01,539 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5084.400000 2021-11-22 00:07:01,545 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:01,546 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:03,082 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5084.400000 2021-11-22 00:07:03,091 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:03,091 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:04,573 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5485.200000 2021-11-22 00:07:04,578 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:04,578 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:06,025 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5485.200000 2021-11-22 00:07:06,029 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:06,030 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:07,454 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5485.200000 2021-11-22 00:07:07,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:07,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:08,959 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5485.200000 2021-11-22 00:07:08,963 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:08,964 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:10,487 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5485.200000 2021-11-22 00:07:10,496 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:10,497 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:12,005 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4396.100000 2021-11-22 00:07:12,013 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:12,013 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:13,467 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:13,473 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:13,474 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:14,989 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:14,996 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:14,996 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:16,561 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:16,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:16,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:18,078 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:18,088 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:18,089 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:19,683 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:19,690 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:19,691 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:21,144 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3125.100000 2021-11-22 00:07:21,151 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:21,151 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:22,654 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3562.200000 2021-11-22 00:07:22,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:22,661 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:24,272 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4104.200000 2021-11-22 00:07:24,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:24,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:25,773 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4104.200000 2021-11-22 00:07:25,779 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:25,779 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:27,359 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4104.200000 2021-11-22 00:07:27,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:27,367 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:28,950 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4104.200000 2021-11-22 00:07:28,957 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:28,959 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:30,493 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4104.200000 2021-11-22 00:07:30,499 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:30,500 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:31,951 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4427.300000 2021-11-22 00:07:31,957 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:31,957 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:33,526 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4427.300000 2021-11-22 00:07:33,532 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:33,532 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:35,069 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4905.400000 2021-11-22 00:07:35,076 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:35,076 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:36,624 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4905.400000 2021-11-22 00:07:36,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:36,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:38,147 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4905.400000 2021-11-22 00:07:38,155 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:38,155 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:39,688 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4905.400000 2021-11-22 00:07:39,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:39,698 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:41,183 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4905.400000 2021-11-22 00:07:41,188 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:41,190 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:42,713 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5088.700000 2021-11-22 00:07:42,720 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:42,721 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:44,272 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5132.100000 2021-11-22 00:07:44,278 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:44,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:45,838 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5132.100000 2021-11-22 00:07:45,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:45,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:47,395 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5132.100000 2021-11-22 00:07:47,403 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:47,403 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:49,020 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5132.100000 2021-11-22 00:07:49,026 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:49,028 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:50,507 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5132.100000 2021-11-22 00:07:50,515 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:50,515 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:51,976 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5080.800000 2021-11-22 00:07:51,983 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:51,983 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:53,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5080.800000 2021-11-22 00:07:53,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:53,461 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:54,957 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.700000 2021-11-22 00:07:54,964 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:54,966 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:56,545 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.700000 2021-11-22 00:07:56,549 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:56,551 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:57,982 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.700000 2021-11-22 00:07:57,990 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:57,990 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:07:59,500 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.700000 2021-11-22 00:07:59,506 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:07:59,506 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:01,029 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5039.700000 2021-11-22 00:08:01,038 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:01,038 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:02,533 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4687.200000 2021-11-22 00:08:02,540 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:02,542 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:04,048 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4341.600000 2021-11-22 00:08:04,056 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:04,058 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:05,552 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4341.600000 2021-11-22 00:08:05,559 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:05,559 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:07,135 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4341.600000 2021-11-22 00:08:07,141 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:07,142 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:08,690 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4341.600000 2021-11-22 00:08:08,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:08,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:10,262 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4341.600000 2021-11-22 00:08:10,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:10,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:11,769 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4482.100000 2021-11-22 00:08:11,775 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:11,775 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:13,339 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4482.100000 2021-11-22 00:08:13,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:13,346 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:14,816 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4597.600000 2021-11-22 00:08:14,823 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:14,825 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:16,321 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4597.600000 2021-11-22 00:08:16,325 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:16,326 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:17,803 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4597.600000 2021-11-22 00:08:17,809 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:17,809 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:19,289 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4597.600000 2021-11-22 00:08:19,295 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:19,296 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:20,796 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4597.600000 2021-11-22 00:08:20,803 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:20,803 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:22,338 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4815.200000 2021-11-22 00:08:22,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:22,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:23,875 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:23,881 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:23,882 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:24,072 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' completed 2021-11-22 00:08:24,073 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' started 2021-11-22 00:08:24,719 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' completed 2021-11-22 00:08:24,720 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13' started 2021-11-22 00:08:24,990 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12' completed 2021-11-22 00:08:24,990 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13' started 2021-11-22 00:08:25,039 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' completed 2021-11-22 00:08:25,039 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' started 2021-11-22 00:08:25,082 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' completed 2021-11-22 00:08:25,084 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13' started 2021-11-22 00:08:25,239 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12' completed 2021-11-22 00:08:25,240 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' started 2021-11-22 00:08:25,355 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:25,359 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:25,361 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:25,716 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12' completed 2021-11-22 00:08:25,717 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13' started 2021-11-22 00:08:25,726 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12' completed 2021-11-22 00:08:25,726 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' started 2021-11-22 00:08:25,733 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12' completed 2021-11-22 00:08:25,734 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13' started 2021-11-22 00:08:26,053 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' completed 2021-11-22 00:08:26,055 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' started 2021-11-22 00:08:26,293 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' completed 2021-11-22 00:08:26,295 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13' started 2021-11-22 00:08:26,809 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:26,818 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:26,818 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:27,052 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' completed 2021-11-22 00:08:27,055 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' started 2021-11-22 00:08:27,345 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12' completed 2021-11-22 00:08:27,345 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13' started 2021-11-22 00:08:27,525 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12' completed 2021-11-22 00:08:27,525 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12' completed 2021-11-22 00:08:27,526 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12 are 26400 2021-11-22 00:08:27,526 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13' started 2021-11-22 00:08:27,526 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' started 2021-11-22 00:08:27,526 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 211200 to 237600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:08:27,526 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:08:27,528 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12 are 26400 2021-11-22 00:08:27,529 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 237600 to 264000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:08:27,529 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:08:27,529 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 are 26400 2021-11-22 00:08:27,530 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 105600 to 132000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:08:27,532 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:08:27,532 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 are 26400 2021-11-22 00:08:27,532 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 132000 to 158400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:08:27,533 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:08:27,533 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12 are 26400 2021-11-22 00:08:27,535 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 264000 to 290400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:08:27,535 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:08:27,536 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12 are 26400 2021-11-22 00:08:27,536 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 158400 to 184800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12 2021-11-22 00:08:27,536 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:08:27,571 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12' completed 2021-11-22 00:08:27,572 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' started 2021-11-22 00:08:27,663 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' completed 2021-11-22 00:08:27,664 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' started 2021-11-22 00:08:28,348 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:28,355 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:28,355 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:28,769 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12' completed 2021-11-22 00:08:28,770 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' started 2021-11-22 00:08:28,867 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12' completed 2021-11-22 00:08:28,868 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' started 2021-11-22 00:08:28,934 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12' completed 2021-11-22 00:08:28,936 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' started 2021-11-22 00:08:29,573 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12' completed 2021-11-22 00:08:29,575 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2' started 2021-11-22 00:08:29,582 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12' completed 2021-11-22 00:08:29,582 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2' started 2021-11-22 00:08:29,795 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:29,799 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:29,799 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:30,539 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12' completed 2021-11-22 00:08:30,540 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2' started 2021-11-22 00:08:30,540 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12 are 26400 2021-11-22 00:08:30,542 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 290400 to 316800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:08:30,542 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:08:30,543 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12 are 26400 2021-11-22 00:08:30,543 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 184800 to 211200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12 2021-11-22 00:08:30,545 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:08:30,546 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12 are 26400 2021-11-22 00:08:30,546 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 316800 to 343200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:08:30,546 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:08:30,546 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 are 26400 2021-11-22 00:08:30,548 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 0 to 26400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12 2021-11-22 00:08:30,549 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:08:30,549 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12 are 26400 2021-11-22 00:08:30,549 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 211200 to 237600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12 2021-11-22 00:08:30,551 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:08:30,552 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12 are 26400 2021-11-22 00:08:30,552 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 343200 to 369600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:08:30,552 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:08:30,553 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 are 26400 2021-11-22 00:08:30,553 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 26400 to 52800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12 2021-11-22 00:08:30,555 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-22 00:08:30,555 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12 are 26400 2021-11-22 00:08:30,555 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 369600 to 396000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12 2021-11-22 00:08:30,556 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:08:30,558 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12 are 26400 2021-11-22 00:08:30,559 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 237600 to 264000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12 2021-11-22 00:08:30,559 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:08:30,559 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 are 26400 2021-11-22 00:08:30,561 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 52800 to 79200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12 2021-11-22 00:08:30,562 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:08:30,562 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12 are 26400 2021-11-22 00:08:30,562 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 264000 to 290400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12 2021-11-22 00:08:30,563 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-22 00:08:30,563 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12 are 26400 2021-11-22 00:08:30,565 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 396000 to 422400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12 2021-11-22 00:08:30,565 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:08:30,565 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 are 26400 2021-11-22 00:08:30,566 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 79200 to 105600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12 2021-11-22 00:08:30,566 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:08:30,568 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12 are 26400 2021-11-22 00:08:30,568 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 290400 to 316800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12 2021-11-22 00:08:30,569 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:08:30,569 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 are 26400 2021-11-22 00:08:30,569 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 105600 to 132000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12 2021-11-22 00:08:30,571 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-22 00:08:30,571 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12 are 26400 2021-11-22 00:08:30,572 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 422400 to 448800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12 2021-11-22 00:08:30,572 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:08:31,288 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5051.700000 2021-11-22 00:08:31,292 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:31,293 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:31,345 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12' completed 2021-11-22 00:08:31,345 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2' started 2021-11-22 00:08:31,345 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12 are 26400 2021-11-22 00:08:31,348 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 316800 to 343200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12 2021-11-22 00:08:31,348 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:08:31,348 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 are 26400 2021-11-22 00:08:31,349 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 132000 to 158400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12 2021-11-22 00:08:31,349 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-22 00:08:32,819 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.700000 2021-11-22 00:08:32,825 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:32,826 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:34,361 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4930.400000 2021-11-22 00:08:34,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:34,369 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:35,783 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4930.400000 2021-11-22 00:08:35,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:35,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:37,299 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4930.400000 2021-11-22 00:08:37,305 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:37,305 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:38,757 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4930.400000 2021-11-22 00:08:38,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:38,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:40,322 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4930.400000 2021-11-22 00:08:40,328 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:40,328 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:41,812 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5020.900000 2021-11-22 00:08:41,818 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:41,819 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:43,280 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5020.900000 2021-11-22 00:08:43,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:43,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:44,780 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-22 00:08:44,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:44,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:46,290 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-22 00:08:46,298 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:46,299 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:47,808 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-22 00:08:47,812 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:47,813 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:49,296 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-22 00:08:49,302 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:49,302 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:50,737 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5103.900000 2021-11-22 00:08:50,744 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:50,744 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:52,184 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5289.400000 2021-11-22 00:08:52,190 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:52,190 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:53,637 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:08:53,641 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:53,642 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:55,125 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:08:55,132 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:55,132 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:56,638 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:08:56,647 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:56,648 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:58,141 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:08:58,148 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:58,148 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:08:59,618 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:08:59,624 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:08:59,624 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:01,045 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5453.000000 2021-11-22 00:09:01,051 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:01,052 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:02,529 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5456.200000 2021-11-22 00:09:02,533 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:02,535 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:02,628 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12' completed 2021-11-22 00:09:02,628 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2' started 2021-11-22 00:09:04,026 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5460.700000 2021-11-22 00:09:04,032 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:04,033 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:04,706 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12' completed 2021-11-22 00:09:04,707 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2' started 2021-11-22 00:09:04,707 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12 are 26400 2021-11-22 00:09:04,707 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 448800 to 475200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12 2021-11-22 00:09:04,709 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:09:04,709 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12 are 26400 2021-11-22 00:09:04,710 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 343200 to 369600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12 2021-11-22 00:09:04,710 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13 2021-11-22 00:09:04,986 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13' completed 2021-11-22 00:09:04,987 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2' started 2021-11-22 00:09:04,987 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13 are 26400 2021-11-22 00:09:04,989 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 158400 to 184800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13 2021-11-22 00:09:04,989 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13 2021-11-22 00:09:05,286 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13' completed 2021-11-22 00:09:05,288 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2' started 2021-11-22 00:09:05,288 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13 are 26400 2021-11-22 00:09:05,288 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 184800 to 211200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13 2021-11-22 00:09:05,289 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-22 00:09:05,484 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5460.700000 2021-11-22 00:09:05,490 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:05,492 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:07,010 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5460.700000 2021-11-22 00:09:07,016 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:07,016 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:08,522 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5460.700000 2021-11-22 00:09:08,528 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:08,528 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:09,993 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5460.700000 2021-11-22 00:09:09,999 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:10,000 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:11,463 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5585.600000 2021-11-22 00:09:11,467 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:11,469 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:12,971 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5585.600000 2021-11-22 00:09:12,977 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:12,979 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:14,441 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5687.000000 2021-11-22 00:09:14,447 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:14,447 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:15,956 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5687.000000 2021-11-22 00:09:15,961 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:15,963 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:17,502 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5687.000000 2021-11-22 00:09:17,509 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:17,509 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:19,029 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5687.000000 2021-11-22 00:09:19,035 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:19,036 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:20,505 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5687.000000 2021-11-22 00:09:20,512 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:20,513 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:21,963 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5629.400000 2021-11-22 00:09:21,969 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:21,970 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:23,446 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5629.400000 2021-11-22 00:09:23,453 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:23,453 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:24,924 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5571.300000 2021-11-22 00:09:24,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:24,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:26,459 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5571.300000 2021-11-22 00:09:26,466 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:26,466 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:27,953 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5571.300000 2021-11-22 00:09:27,960 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:27,961 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:29,513 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5571.300000 2021-11-22 00:09:29,519 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:29,520 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:31,013 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5571.300000 2021-11-22 00:09:31,019 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:31,019 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:32,578 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5472.200000 2021-11-22 00:09:32,584 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:32,585 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:34,099 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5326.500000 2021-11-22 00:09:34,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:34,107 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:35,595 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5326.500000 2021-11-22 00:09:35,601 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:35,601 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:37,062 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5326.500000 2021-11-22 00:09:37,071 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:37,072 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:38,595 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5326.500000 2021-11-22 00:09:38,601 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:38,602 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:40,092 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5326.500000 2021-11-22 00:09:40,101 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:40,101 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:41,625 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5266.100000 2021-11-22 00:09:41,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:41,632 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:43,111 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5266.100000 2021-11-22 00:09:43,118 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:43,118 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:44,540 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5333.300000 2021-11-22 00:09:44,546 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:44,546 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:45,953 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5333.300000 2021-11-22 00:09:45,960 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:45,960 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:47,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5333.300000 2021-11-22 00:09:47,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:47,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:48,924 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5333.300000 2021-11-22 00:09:48,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:48,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:50,438 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5333.300000 2021-11-22 00:09:50,444 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:50,446 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:51,969 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5456.800000 2021-11-22 00:09:51,974 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:51,976 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:53,494 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5456.800000 2021-11-22 00:09:53,500 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:53,500 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:54,990 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5497.400000 2021-11-22 00:09:54,996 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:54,996 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:56,520 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5497.400000 2021-11-22 00:09:56,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:56,528 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:58,032 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5497.400000 2021-11-22 00:09:58,039 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:58,039 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:09:59,622 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5497.400000 2021-11-22 00:09:59,630 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:09:59,630 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:01,127 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5497.400000 2021-11-22 00:10:01,134 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:01,134 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:02,598 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5447.400000 2021-11-22 00:10:02,607 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:02,608 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:04,147 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5379.900000 2021-11-22 00:10:04,153 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:04,154 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:05,690 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5379.900000 2021-11-22 00:10:05,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:05,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:07,174 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5379.900000 2021-11-22 00:10:07,180 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:07,180 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:08,644 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5379.900000 2021-11-22 00:10:08,648 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:08,650 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:10,105 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5379.900000 2021-11-22 00:10:10,115 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:10,115 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:11,608 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5265.100000 2021-11-22 00:10:11,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:11,617 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:13,046 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5265.100000 2021-11-22 00:10:13,052 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:13,052 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:14,528 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5189.000000 2021-11-22 00:10:14,536 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:14,536 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:15,970 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5189.000000 2021-11-22 00:10:15,976 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:15,977 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:17,474 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5189.000000 2021-11-22 00:10:17,480 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:17,482 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:19,003 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5189.000000 2021-11-22 00:10:19,007 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:19,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:20,447 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5189.000000 2021-11-22 00:10:20,453 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:20,453 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:21,946 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5216.900000 2021-11-22 00:10:21,951 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:21,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:23,411 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5216.900000 2021-11-22 00:10:23,415 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:23,415 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:24,878 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5155.700000 2021-11-22 00:10:24,884 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:24,884 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:26,391 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5155.700000 2021-11-22 00:10:26,397 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:26,398 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:27,846 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5155.700000 2021-11-22 00:10:27,852 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:27,854 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:29,280 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5155.700000 2021-11-22 00:10:29,288 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:29,289 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:30,736 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5155.700000 2021-11-22 00:10:30,742 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:30,742 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:32,244 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5065.800000 2021-11-22 00:10:32,250 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:32,250 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:33,717 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:33,723 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:33,723 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:35,246 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:35,252 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:35,253 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:35,563 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13' completed 2021-11-22 00:10:35,565 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2' started 2021-11-22 00:10:35,677 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' completed 2021-11-22 00:10:35,677 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2' started 2021-11-22 00:10:35,678 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 are 26400 2021-11-22 00:10:35,678 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 369600 to 396000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-22 00:10:35,680 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:36,193 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13' completed 2021-11-22 00:10:36,194 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2' started 2021-11-22 00:10:36,687 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:36,696 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:36,697 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:36,737 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' completed 2021-11-22 00:10:36,737 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2' started 2021-11-22 00:10:36,773 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13' completed 2021-11-22 00:10:36,775 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2' started 2021-11-22 00:10:36,776 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13 are 26400 2021-11-22 00:10:36,776 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 475200 to 501600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:36,776 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13 2021-11-22 00:10:36,872 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' completed 2021-11-22 00:10:36,872 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2' started 2021-11-22 00:10:36,986 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' completed 2021-11-22 00:10:36,987 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2' started 2021-11-22 00:10:37,372 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' completed 2021-11-22 00:10:37,374 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2' started 2021-11-22 00:10:37,441 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13' completed 2021-11-22 00:10:37,444 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2' started 2021-11-22 00:10:37,505 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13' completed 2021-11-22 00:10:37,506 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2' started 2021-11-22 00:10:37,592 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' completed 2021-11-22 00:10:37,594 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2' started 2021-11-22 00:10:37,825 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' completed 2021-11-22 00:10:37,826 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2' started 2021-11-22 00:10:37,855 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' completed 2021-11-22 00:10:37,857 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2' started 2021-11-22 00:10:37,996 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13' completed 2021-11-22 00:10:37,997 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2' started 2021-11-22 00:10:37,997 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13 are 26400 2021-11-22 00:10:37,999 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 211200 to 237600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13 2021-11-22 00:10:37,999 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-22 00:10:38,000 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 are 26400 2021-11-22 00:10:38,000 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 396000 to 422400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-22 00:10:38,002 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:38,002 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13 are 26400 2021-11-22 00:10:38,003 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 501600 to 528000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:38,003 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-22 00:10:38,003 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 are 26400 2021-11-22 00:10:38,003 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 422400 to 448800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-22 00:10:38,005 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13 2021-11-22 00:10:38,005 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13 are 26400 2021-11-22 00:10:38,006 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 237600 to 264000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13 2021-11-22 00:10:38,006 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-22 00:10:38,006 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 are 26400 2021-11-22 00:10:38,007 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 448800 to 475200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-22 00:10:38,007 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13 2021-11-22 00:10:38,009 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13 are 26400 2021-11-22 00:10:38,009 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 264000 to 290400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13 2021-11-22 00:10:38,009 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:38,010 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 are 26400 2021-11-22 00:10:38,012 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 475200 to 501600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:38,013 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13 2021-11-22 00:10:38,055 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' completed 2021-11-22 00:10:38,055 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2' started 2021-11-22 00:10:38,101 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' completed 2021-11-22 00:10:38,101 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2' started 2021-11-22 00:10:38,115 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' completed 2021-11-22 00:10:38,117 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2' started 2021-11-22 00:10:38,119 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:38,125 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:38,125 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:38,647 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' completed 2021-11-22 00:10:38,648 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2' started 2021-11-22 00:10:39,582 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:39,588 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:39,588 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:39,976 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13' completed 2021-11-22 00:10:39,976 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2' started 2021-11-22 00:10:39,990 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13' completed 2021-11-22 00:10:39,990 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2' started 2021-11-22 00:10:39,990 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13 are 26400 2021-11-22 00:10:39,992 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 290400 to 316800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13 2021-11-22 00:10:39,993 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:39,993 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 are 26400 2021-11-22 00:10:39,994 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 501600 to 528000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:39,994 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13 2021-11-22 00:10:39,996 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13 are 26400 2021-11-22 00:10:39,996 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 316800 to 343200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13 2021-11-22 00:10:39,996 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13 2021-11-22 00:10:39,997 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13 are 26400 2021-11-22 00:10:39,999 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 343200 to 369600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13 2021-11-22 00:10:39,999 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-22 00:10:40,000 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 are 26400 2021-11-22 00:10:40,000 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 369600 to 396000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13 2021-11-22 00:10:40,000 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-22 00:10:40,002 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 are 26400 2021-11-22 00:10:40,002 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 396000 to 422400 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13 2021-11-22 00:10:40,003 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-22 00:10:40,003 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 are 26400 2021-11-22 00:10:40,003 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 422400 to 448800 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13 2021-11-22 00:10:40,005 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-22 00:10:40,005 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 are 26400 2021-11-22 00:10:40,006 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 448800 to 475200 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13 2021-11-22 00:10:40,006 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:40,006 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 are 26400 2021-11-22 00:10:40,007 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 475200 to 501600 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13 2021-11-22 00:10:40,007 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:40,009 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 are 26400 2021-11-22 00:10:40,009 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 501600 to 528000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13 2021-11-22 00:10:40,009 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:10:41,069 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5091.000000 2021-11-22 00:10:41,073 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:41,075 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:42,536 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 5042.600000 2021-11-22 00:10:42,543 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:42,543 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:44,036 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4936.700000 2021-11-22 00:10:44,042 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:44,043 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:45,582 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4936.700000 2021-11-22 00:10:45,591 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:45,592 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:47,055 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4936.700000 2021-11-22 00:10:47,061 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:47,062 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:48,548 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4936.700000 2021-11-22 00:10:48,552 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:48,553 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:50,000 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4936.700000 2021-11-22 00:10:50,006 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:50,006 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:50,411 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2' completed 2021-11-22 00:10:50,413 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2' started 2021-11-22 00:10:50,986 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2' completed 2021-11-22 00:10:50,987 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2' started 2021-11-22 00:10:50,987 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2 are 22000 2021-11-22 00:10:50,989 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2200000 to 2222000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:10:50,989 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:10:50,990 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2 are 22000 2021-11-22 00:10:50,990 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2200000 to 2222000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:10:50,990 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:10:51,426 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4704.300000 2021-11-22 00:10:51,431 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:51,433 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:51,779 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2' completed 2021-11-22 00:10:51,780 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2' started 2021-11-22 00:10:52,207 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2' completed 2021-11-22 00:10:52,207 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2' started 2021-11-22 00:10:52,207 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2 are 22000 2021-11-22 00:10:52,209 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2222000 to 2244000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:10:52,210 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:10:52,210 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2 are 22000 2021-11-22 00:10:52,210 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2222000 to 2244000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:10:52,211 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:10:52,921 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4704.300000 2021-11-22 00:10:52,926 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:52,927 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:54,392 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.300000 2021-11-22 00:10:54,398 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:54,400 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:55,877 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.300000 2021-11-22 00:10:55,881 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:55,882 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:57,375 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.300000 2021-11-22 00:10:57,381 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:57,382 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:10:58,835 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.300000 2021-11-22 00:10:58,841 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:10:58,842 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:00,331 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4463.300000 2021-11-22 00:11:00,338 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:00,338 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:01,780 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4607.600000 2021-11-22 00:11:01,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:01,788 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:03,288 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4607.600000 2021-11-22 00:11:03,293 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:03,295 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:04,726 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.700000 2021-11-22 00:11:04,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:04,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:06,257 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.700000 2021-11-22 00:11:06,262 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:06,263 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:07,732 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.700000 2021-11-22 00:11:07,736 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:07,737 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:09,184 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.700000 2021-11-22 00:11:09,190 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:09,191 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:10,700 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4859.700000 2021-11-22 00:11:10,704 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:10,706 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:12,140 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4925.500000 2021-11-22 00:11:12,145 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:12,147 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:13,743 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:13,747 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:13,749 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:15,230 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:15,236 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:15,237 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:16,729 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:16,737 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:16,739 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:18,187 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:18,194 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:18,194 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:19,318 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2' completed 2021-11-22 00:11:19,319 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2' started 2021-11-22 00:11:19,319 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2 are 22000 2021-11-22 00:11:19,319 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2244000 to 2266000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:11:19,321 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:11:19,648 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:19,653 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:19,654 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:21,108 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4864.700000 2021-11-22 00:11:21,114 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:21,115 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:21,592 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2' completed 2021-11-22 00:11:21,592 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2' started 2021-11-22 00:11:21,592 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2 are 22000 2021-11-22 00:11:21,594 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2244000 to 2266000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:11:21,594 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:11:22,638 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4858.800000 2021-11-22 00:11:22,642 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:22,644 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:22,779 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2' completed 2021-11-22 00:11:22,779 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2' started 2021-11-22 00:11:22,779 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2 are 22000 2021-11-22 00:11:22,780 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2266000 to 2288000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:11:22,782 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:11:22,927 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2' completed 2021-11-22 00:11:22,927 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2' started 2021-11-22 00:11:22,927 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2 are 22000 2021-11-22 00:11:22,927 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2200000 to 2222000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2 2021-11-22 00:11:22,928 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:11:24,088 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:24,095 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:24,095 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:25,496 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:25,502 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:25,503 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:26,940 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:26,947 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:26,947 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:28,362 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:28,369 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:28,371 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:29,845 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:29,852 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:29,854 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:31,359 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4937.100000 2021-11-22 00:11:31,367 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:31,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:32,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.700000 2021-11-22 00:11:32,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:32,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:34,250 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4952.500000 2021-11-22 00:11:34,255 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:34,256 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:35,727 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4952.500000 2021-11-22 00:11:35,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:35,733 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:37,214 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4952.500000 2021-11-22 00:11:37,221 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:37,221 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:38,698 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4952.500000 2021-11-22 00:11:38,704 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:38,706 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:40,188 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4952.500000 2021-11-22 00:11:40,194 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:40,194 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:41,634 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4933.400000 2021-11-22 00:11:41,638 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:41,640 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:43,075 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4933.400000 2021-11-22 00:11:43,079 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:43,081 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:44,568 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4917.300000 2021-11-22 00:11:44,572 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:44,572 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:46,092 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4917.300000 2021-11-22 00:11:46,098 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:46,098 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:47,575 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4917.300000 2021-11-22 00:11:47,584 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:47,584 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:49,019 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4917.300000 2021-11-22 00:11:49,023 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:49,023 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:50,490 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4917.300000 2021-11-22 00:11:50,496 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:50,497 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:51,940 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.400000 2021-11-22 00:11:51,946 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:51,946 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:53,460 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4950.400000 2021-11-22 00:11:53,469 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:53,469 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:54,938 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4989.000000 2021-11-22 00:11:54,944 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:54,946 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:56,368 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4989.000000 2021-11-22 00:11:56,372 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:56,374 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:57,887 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4989.000000 2021-11-22 00:11:57,891 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:57,892 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:11:59,348 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4989.000000 2021-11-22 00:11:59,354 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:11:59,354 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:00,759 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4989.000000 2021-11-22 00:12:00,766 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:00,766 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:02,219 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4954.900000 2021-11-22 00:12:02,224 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:02,226 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:03,684 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:03,690 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:03,690 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:05,200 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:05,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:05,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:06,678 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:06,686 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:06,686 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:08,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:08,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:08,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:09,609 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:09,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:09,617 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:11,029 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4916.000000 2021-11-22 00:12:11,036 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:11,036 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:12,519 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4913.000000 2021-11-22 00:12:12,525 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:12,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:14,039 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:14,045 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:14,046 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:15,535 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:15,540 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:15,540 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:16,937 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:16,943 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:16,943 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:18,339 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:18,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:18,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:19,776 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:19,782 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:19,783 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:21,203 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4932.700000 2021-11-22 00:12:21,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:21,209 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:22,676 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.500000 2021-11-22 00:12:22,681 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:22,681 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:24,145 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:24,151 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:24,151 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:25,586 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:25,592 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:25,592 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:27,013 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:27,020 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:27,020 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:28,486 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:28,492 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:28,493 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:29,953 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:29,959 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:29,960 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:31,407 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4946.200000 2021-11-22 00:12:31,411 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:31,413 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:32,885 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4935.500000 2021-11-22 00:12:32,892 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:32,894 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:34,342 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.900000 2021-11-22 00:12:34,348 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:34,348 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:35,842 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.900000 2021-11-22 00:12:35,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:35,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:37,358 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.900000 2021-11-22 00:12:37,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:37,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:38,799 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.900000 2021-11-22 00:12:38,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:38,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:40,328 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4966.900000 2021-11-22 00:12:40,335 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:40,335 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:41,773 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2' completed 2021-11-22 00:12:41,775 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2' started 2021-11-22 00:12:41,775 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2 are 22000 2021-11-22 00:12:41,776 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2266000 to 2288000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:12:41,776 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:41,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.700000 2021-11-22 00:12:41,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:41,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:41,907 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2' completed 2021-11-22 00:12:41,907 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2' started 2021-11-22 00:12:41,908 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2 are 22000 2021-11-22 00:12:41,910 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2288000 to 2310000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:41,910 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:12:42,312 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2' completed 2021-11-22 00:12:42,312 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2' started 2021-11-22 00:12:42,532 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2' completed 2021-11-22 00:12:42,533 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2' started 2021-11-22 00:12:42,533 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2 are 22000 2021-11-22 00:12:42,535 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2222000 to 2244000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2 2021-11-22 00:12:42,536 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:43,013 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2' completed 2021-11-22 00:12:43,015 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2' started 2021-11-22 00:12:43,230 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2' completed 2021-11-22 00:12:43,232 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2' started 2021-11-22 00:12:43,273 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4957.700000 2021-11-22 00:12:43,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:43,280 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:43,365 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2' completed 2021-11-22 00:12:43,367 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2' started 2021-11-22 00:12:43,367 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2 are 22000 2021-11-22 00:12:43,368 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2288000 to 2310000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:43,368 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:12:43,368 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2 are 22000 2021-11-22 00:12:43,369 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2244000 to 2266000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2 2021-11-22 00:12:43,371 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:43,665 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2' completed 2021-11-22 00:12:43,667 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2' started 2021-11-22 00:12:43,667 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2 are 22000 2021-11-22 00:12:43,668 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2310000 to 2332000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:43,670 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:43,671 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2 are 22000 2021-11-22 00:12:43,671 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2310000 to 2332000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:43,671 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:12:43,983 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2' completed 2021-11-22 00:12:43,983 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2' started 2021-11-22 00:12:43,989 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2' completed 2021-11-22 00:12:43,990 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2' started 2021-11-22 00:12:44,042 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2' completed 2021-11-22 00:12:44,042 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2' started 2021-11-22 00:12:44,229 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2' completed 2021-11-22 00:12:44,230 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2' started 2021-11-22 00:12:44,230 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2' completed 2021-11-22 00:12:44,230 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2' started 2021-11-22 00:12:44,351 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2' completed 2021-11-22 00:12:44,354 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2' started 2021-11-22 00:12:44,424 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2' completed 2021-11-22 00:12:44,424 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2' started 2021-11-22 00:12:44,426 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2 are 22000 2021-11-22 00:12:44,426 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2266000 to 2288000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2 2021-11-22 00:12:44,427 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:44,427 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2 are 22000 2021-11-22 00:12:44,427 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2332000 to 2354000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:44,428 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:44,430 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2 are 22000 2021-11-22 00:12:44,430 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2332000 to 2354000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:44,430 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:44,431 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2 are 22000 2021-11-22 00:12:44,431 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2288000 to 2310000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2 2021-11-22 00:12:44,433 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:44,433 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2 are 22000 2021-11-22 00:12:44,434 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2354000 to 2376000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:44,434 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:44,434 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2 are 22000 2021-11-22 00:12:44,436 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2354000 to 2376000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:44,437 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:44,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.600000 2021-11-22 00:12:44,782 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2' completed 2021-11-22 00:12:44,783 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2' started 2021-11-22 00:12:44,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:44,788 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:45,470 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2' completed 2021-11-22 00:12:45,470 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2' started 2021-11-22 00:12:45,470 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2 are 22000 2021-11-22 00:12:45,473 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2310000 to 2332000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2 2021-11-22 00:12:45,474 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:45,476 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2 are 22000 2021-11-22 00:12:45,476 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2376000 to 2398000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:45,476 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:45,477 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2 are 22000 2021-11-22 00:12:45,479 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2376000 to 2398000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:45,479 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:45,480 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2 are 22000 2021-11-22 00:12:45,480 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2332000 to 2354000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2 2021-11-22 00:12:45,480 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:12:45,628 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2' completed 2021-11-22 00:12:45,630 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2' started 2021-11-22 00:12:45,630 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2 are 22000 2021-11-22 00:12:45,631 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2398000 to 2420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:12:45,631 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:12:46,260 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.600000 2021-11-22 00:12:46,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:46,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:46,313 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2' completed 2021-11-22 00:12:46,315 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2' started 2021-11-22 00:12:46,532 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2' completed 2021-11-22 00:12:46,533 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2' started 2021-11-22 00:12:46,533 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2 are 22000 2021-11-22 00:12:46,535 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2398000 to 2420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:12:46,536 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:46,536 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2 are 22000 2021-11-22 00:12:46,536 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2354000 to 2376000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2 2021-11-22 00:12:46,538 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:12:47,796 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.600000 2021-11-22 00:12:47,802 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:47,803 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:49,256 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.600000 2021-11-22 00:12:49,263 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:49,263 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:50,710 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4902.600000 2021-11-22 00:12:50,719 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:50,719 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:52,173 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4822.400000 2021-11-22 00:12:52,180 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:52,180 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:53,654 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:12:53,661 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:53,663 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:55,151 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:12:55,158 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:55,160 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:55,220 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2' completed 2021-11-22 00:12:55,221 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2' started 2021-11-22 00:12:55,221 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2 are 22000 2021-11-22 00:12:55,223 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2420000 to 2442000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:12:55,223 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:12:55,785 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2' completed 2021-11-22 00:12:55,786 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2' started 2021-11-22 00:12:55,786 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2 are 22000 2021-11-22 00:12:55,789 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2420000 to 2442000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:12:55,789 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:56,625 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:12:56,631 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:56,632 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:57,673 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2' completed 2021-11-22 00:12:57,674 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2' started 2021-11-22 00:12:57,674 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2 are 22000 2021-11-22 00:12:57,674 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2376000 to 2398000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2 2021-11-22 00:12:57,676 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:12:58,138 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:12:58,144 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:58,145 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:12:58,299 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2' completed 2021-11-22 00:12:58,301 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2' started 2021-11-22 00:12:58,302 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2 are 22000 2021-11-22 00:12:58,302 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2442000 to 2464000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:12:58,303 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:12:59,566 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:12:59,572 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:12:59,573 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:01,032 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4759.500000 2021-11-22 00:13:01,039 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:01,039 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:02,520 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:02,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:02,528 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:03,996 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:04,003 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:04,003 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:05,484 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:05,490 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:05,492 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:06,954 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:06,961 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:06,963 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:08,551 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:08,558 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:08,559 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:10,026 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4782.100000 2021-11-22 00:13:10,032 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:10,032 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:11,519 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4773.400000 2021-11-22 00:13:11,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:11,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:13,049 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4773.400000 2021-11-22 00:13:13,056 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:13,056 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:14,561 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4868.800000 2021-11-22 00:13:14,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:14,569 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:16,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4868.800000 2021-11-22 00:13:16,121 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:16,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:17,579 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4868.800000 2021-11-22 00:13:17,586 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:17,588 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:19,098 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4868.800000 2021-11-22 00:13:19,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:19,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:20,622 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4868.800000 2021-11-22 00:13:20,630 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:20,630 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:22,115 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4858.600000 2021-11-22 00:13:22,121 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:22,121 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:23,720 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:23,727 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:23,729 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:24,269 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2' completed 2021-11-22 00:13:24,270 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21' started 2021-11-22 00:13:24,272 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2 are 22000 2021-11-22 00:13:24,273 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2442000 to 2464000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:13:24,273 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:13:25,328 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:25,338 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:25,339 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:26,855 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:26,864 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:26,865 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:28,335 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:28,344 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:28,345 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:28,403 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2' completed 2021-11-22 00:13:28,404 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21' started 2021-11-22 00:13:28,404 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2 are 22000 2021-11-22 00:13:28,405 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2398000 to 2420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2 2021-11-22 00:13:28,407 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:13:28,957 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2' completed 2021-11-22 00:13:28,959 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21' started 2021-11-22 00:13:29,427 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2' completed 2021-11-22 00:13:29,428 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21' started 2021-11-22 00:13:29,428 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2 are 22000 2021-11-22 00:13:29,430 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2464000 to 2486000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:13:29,431 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:13:29,431 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2 are 22000 2021-11-22 00:13:29,433 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2464000 to 2486000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:13:29,433 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:13:29,901 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:29,905 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:29,907 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:31,381 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4694.900000 2021-11-22 00:13:31,388 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:31,388 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:32,878 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4599.000000 2021-11-22 00:13:32,885 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:32,885 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:34,434 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4559.600000 2021-11-22 00:13:34,438 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:34,438 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:35,927 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4559.600000 2021-11-22 00:13:35,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:35,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:37,404 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4559.600000 2021-11-22 00:13:37,411 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:37,411 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:38,884 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4559.600000 2021-11-22 00:13:38,891 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:38,891 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:40,335 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4559.600000 2021-11-22 00:13:40,342 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:40,342 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:41,799 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4621.100000 2021-11-22 00:13:41,805 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:41,806 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:43,290 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4621.100000 2021-11-22 00:13:43,298 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:43,299 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:44,806 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.000000 2021-11-22 00:13:44,812 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:44,813 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:46,289 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.000000 2021-11-22 00:13:46,296 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:46,298 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:47,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.000000 2021-11-22 00:13:47,789 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:47,790 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:49,292 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.000000 2021-11-22 00:13:49,298 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:49,299 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:50,808 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4714.000000 2021-11-22 00:13:50,813 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:50,815 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:52,249 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4750.700000 2021-11-22 00:13:52,256 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:52,256 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:53,714 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:13:53,720 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:53,721 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:55,207 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:13:55,214 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:55,214 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:56,736 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:13:56,743 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:56,744 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:58,207 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:13:58,214 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:58,216 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:13:59,664 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:13:59,670 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:13:59,671 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:01,131 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4755.900000 2021-11-22 00:14:01,138 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:01,138 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:02,711 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4741.300000 2021-11-22 00:14:02,719 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:02,720 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:04,292 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4752.500000 2021-11-22 00:14:04,299 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:04,299 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:05,782 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4752.500000 2021-11-22 00:14:05,790 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:05,792 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:07,246 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4752.500000 2021-11-22 00:14:07,252 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:07,253 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:08,709 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4752.500000 2021-11-22 00:14:08,716 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:08,716 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:10,239 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4752.500000 2021-11-22 00:14:10,244 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:10,246 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:12,003 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4718.800000 2021-11-22 00:14:12,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:12,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:13,812 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:13,818 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:13,819 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:15,295 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:15,301 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:15,301 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:16,806 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:16,813 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:16,815 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:18,260 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:18,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:18,266 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:19,727 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:19,734 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:19,736 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:21,217 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4713.300000 2021-11-22 00:14:21,223 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:21,223 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:22,688 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4730.300000 2021-11-22 00:14:22,694 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:22,696 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:24,280 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4684.700000 2021-11-22 00:14:24,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:24,288 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:25,743 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4684.700000 2021-11-22 00:14:25,750 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:25,750 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:27,262 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4684.700000 2021-11-22 00:14:27,267 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:27,269 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:28,756 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4684.700000 2021-11-22 00:14:28,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:28,763 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:30,279 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4684.700000 2021-11-22 00:14:30,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:30,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:31,779 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.400000 2021-11-22 00:14:31,786 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:31,788 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:33,275 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4717.400000 2021-11-22 00:14:33,280 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:33,282 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:34,743 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.500000 2021-11-22 00:14:34,750 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:34,750 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:36,272 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.500000 2021-11-22 00:14:36,278 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:36,279 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:37,717 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.500000 2021-11-22 00:14:37,723 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:37,724 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:39,190 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.500000 2021-11-22 00:14:39,196 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:39,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:40,615 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.500000 2021-11-22 00:14:40,621 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:40,622 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:42,085 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4804.700000 2021-11-22 00:14:42,089 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:42,091 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:43,588 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:43,596 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:43,598 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:45,099 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:45,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:45,105 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:46,553 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:46,559 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:46,559 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:47,997 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:48,003 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:48,005 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:49,450 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:49,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:49,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:50,927 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4743.800000 2021-11-22 00:14:50,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:50,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:51,601 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2' completed 2021-11-22 00:14:51,604 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2 are 22000 2021-11-22 00:14:51,604 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21' started 2021-11-22 00:14:51,605 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2420000 to 2442000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2 2021-11-22 00:14:51,605 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:52,390 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2' completed 2021-11-22 00:14:52,391 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21' started 2021-11-22 00:14:52,450 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4673.700000 2021-11-22 00:14:52,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:52,457 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:52,835 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2' completed 2021-11-22 00:14:52,835 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21' started 2021-11-22 00:14:52,835 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2 are 22000 2021-11-22 00:14:52,836 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2486000 to 2508000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:52,836 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:14:53,193 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2' completed 2021-11-22 00:14:53,194 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21' started 2021-11-22 00:14:53,194 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2 are 22000 2021-11-22 00:14:53,194 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2442000 to 2464000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2 2021-11-22 00:14:53,196 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:53,197 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2 are 22000 2021-11-22 00:14:53,197 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2486000 to 2508000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:53,197 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:53,976 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:14:53,983 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:53,983 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:54,076 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2' completed 2021-11-22 00:14:54,078 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21' started 2021-11-22 00:14:54,121 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2' completed 2021-11-22 00:14:54,122 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21' started 2021-11-22 00:14:54,134 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2' completed 2021-11-22 00:14:54,134 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21' started 2021-11-22 00:14:54,138 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2' completed 2021-11-22 00:14:54,138 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21' started 2021-11-22 00:14:54,279 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2' completed 2021-11-22 00:14:54,280 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21' started 2021-11-22 00:14:54,306 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2' completed 2021-11-22 00:14:54,308 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21' started 2021-11-22 00:14:54,308 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2 are 22000 2021-11-22 00:14:54,309 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2508000 to 2530000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:54,309 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:14:54,311 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2 are 22000 2021-11-22 00:14:54,312 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2464000 to 2486000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2 2021-11-22 00:14:54,312 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:54,312 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2 are 22000 2021-11-22 00:14:54,313 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2508000 to 2530000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:54,315 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:54,451 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2' completed 2021-11-22 00:14:54,453 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21' started 2021-11-22 00:14:54,453 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2 are 22000 2021-11-22 00:14:54,453 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2486000 to 2508000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2 2021-11-22 00:14:54,454 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:54,454 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2 are 22000 2021-11-22 00:14:54,456 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2530000 to 2552000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:54,457 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:54,457 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2 are 22000 2021-11-22 00:14:54,457 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2530000 to 2552000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:54,459 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:54,595 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2' completed 2021-11-22 00:14:54,595 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21' started 2021-11-22 00:14:54,684 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2' completed 2021-11-22 00:14:54,686 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21' started 2021-11-22 00:14:54,686 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2 are 22000 2021-11-22 00:14:54,687 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2508000 to 2530000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2 2021-11-22 00:14:54,687 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:54,842 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2' completed 2021-11-22 00:14:54,842 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21' started 2021-11-22 00:14:55,035 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2' completed 2021-11-22 00:14:55,036 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21' started 2021-11-22 00:14:55,036 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2 are 22000 2021-11-22 00:14:55,036 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2552000 to 2574000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:55,036 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:55,038 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2 are 22000 2021-11-22 00:14:55,039 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2552000 to 2574000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:55,039 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:14:55,413 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2' completed 2021-11-22 00:14:55,414 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21' started 2021-11-22 00:14:55,476 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:14:55,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:55,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:55,641 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2' completed 2021-11-22 00:14:55,641 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2 are 22000 2021-11-22 00:14:55,642 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2574000 to 2596000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:14:55,644 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:55,644 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2 are 22000 2021-11-22 00:14:55,645 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2530000 to 2552000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2 2021-11-22 00:14:55,647 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:14:55,647 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2 are 22000 2021-11-22 00:14:55,648 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2574000 to 2596000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:14:55,648 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:14:55,650 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2 are 22000 2021-11-22 00:14:55,651 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2596000 to 2618000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:14:55,651 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:56,052 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2' completed 2021-11-22 00:14:56,053 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2 are 22000 2021-11-22 00:14:56,055 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2552000 to 2574000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2 2021-11-22 00:14:56,055 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:14:56,092 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2' completed 2021-11-22 00:14:56,094 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2 are 22000 2021-11-22 00:14:56,095 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2596000 to 2618000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:14:56,095 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:14:56,286 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2' completed 2021-11-22 00:14:56,289 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2 are 22000 2021-11-22 00:14:56,289 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2618000 to 2640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:14:56,289 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:14:57,003 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:14:57,009 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:57,010 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:58,464 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:14:58,471 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:58,473 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:14:59,930 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:14:59,937 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:14:59,937 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:01,443 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4625.700000 2021-11-22 00:15:01,448 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:01,448 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:02,917 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4568.400000 2021-11-22 00:15:02,923 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:02,923 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:04,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4507.900000 2021-11-22 00:15:04,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:04,460 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:05,378 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2' completed 2021-11-22 00:15:05,380 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2 are 22000 2021-11-22 00:15:05,381 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2574000 to 2596000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2 2021-11-22 00:15:05,381 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:15:05,815 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2' completed 2021-11-22 00:15:05,818 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2 are 22000 2021-11-22 00:15:05,819 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2618000 to 2640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:15:05,819 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:15:05,924 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4507.900000 2021-11-22 00:15:05,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:05,930 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:07,484 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4507.900000 2021-11-22 00:15:07,492 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:07,492 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:07,762 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2' completed 2021-11-22 00:15:07,763 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2 are 22000 2021-11-22 00:15:07,763 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2596000 to 2618000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2 2021-11-22 00:15:07,763 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:15:07,887 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2' completed 2021-11-22 00:15:07,888 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2 are 22000 2021-11-22 00:15:07,890 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2618000 to 2640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2 2021-11-22 00:15:07,890 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21 2021-11-22 00:15:08,944 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4507.900000 2021-11-22 00:15:08,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:08,953 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:10,420 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4507.900000 2021-11-22 00:15:10,427 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:10,427 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:11,930 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4344.500000 2021-11-22 00:15:11,938 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:11,938 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:13,441 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4344.500000 2021-11-22 00:15:13,447 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:13,447 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:14,868 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4202.200000 2021-11-22 00:15:14,875 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:14,875 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:16,303 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4202.200000 2021-11-22 00:15:16,311 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:16,311 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:17,721 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4202.200000 2021-11-22 00:15:17,727 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:17,729 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:19,177 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4202.200000 2021-11-22 00:15:19,184 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:19,184 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:20,630 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4202.200000 2021-11-22 00:15:20,635 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:20,635 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:22,069 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4160.000000 2021-11-22 00:15:22,075 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:22,076 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:23,519 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4094.700000 2021-11-22 00:15:23,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:23,526 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:25,017 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4094.700000 2021-11-22 00:15:25,023 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:25,023 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:27,660 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4094.700000 2021-11-22 00:15:27,667 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:27,667 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:29,476 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21' completed 2021-11-22 00:15:29,479 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21 are 22000 2021-11-22 00:15:29,480 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2200000 to 2222000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21 2021-11-22 00:15:29,480 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21 2021-11-22 00:15:29,609 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4094.700000 2021-11-22 00:15:29,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:29,615 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:31,051 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4094.700000 2021-11-22 00:15:31,055 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:31,056 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:32,322 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21' completed 2021-11-22 00:15:32,322 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21 are 22000 2021-11-22 00:15:32,323 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2222000 to 2244000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21 2021-11-22 00:15:32,323 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21 2021-11-22 00:15:32,523 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4108.100000 2021-11-22 00:15:32,529 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:32,529 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:32,655 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21' completed 2021-11-22 00:15:32,657 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21 are 22000 2021-11-22 00:15:32,657 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2244000 to 2266000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21 2021-11-22 00:15:32,657 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21 2021-11-22 00:15:32,808 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21' completed 2021-11-22 00:15:32,809 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21 are 22000 2021-11-22 00:15:32,809 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2266000 to 2288000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21 2021-11-22 00:15:32,811 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21 2021-11-22 00:15:33,969 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:33,974 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:33,976 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:35,431 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:35,438 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:35,440 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:36,880 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:36,887 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:36,887 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:38,361 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:38,365 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:38,367 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:39,816 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:39,822 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:39,822 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:41,279 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4141.700000 2021-11-22 00:15:41,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:41,286 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:42,704 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 4002.900000 2021-11-22 00:15:42,711 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:42,713 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:44,191 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:44,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:44,197 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:45,601 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:45,608 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:45,608 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:47,062 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:47,068 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:47,068 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:48,479 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:48,483 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:48,484 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:49,917 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:49,923 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:49,924 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:51,420 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3806.500000 2021-11-22 00:15:51,424 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:51,426 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:52,842 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3729.500000 2021-11-22 00:15:52,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:52,848 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:54,259 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:15:54,263 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:54,265 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:55,697 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:15:55,703 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:55,703 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:57,118 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:15:57,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:57,122 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:58,540 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:15:58,546 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:58,546 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:15:59,971 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:15:59,979 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:15:59,980 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:01,453 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3730.900000 2021-11-22 00:16:01,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:01,459 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:02,911 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3774.600000 2021-11-22 00:16:02,915 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:02,915 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:04,394 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3769.200000 2021-11-22 00:16:04,400 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:04,400 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:05,838 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3769.200000 2021-11-22 00:16:05,844 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:05,844 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:07,298 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3769.200000 2021-11-22 00:16:07,302 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:07,302 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:08,696 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3769.200000 2021-11-22 00:16:08,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:08,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:10,201 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3769.200000 2021-11-22 00:16:10,207 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:10,209 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:11,588 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3705.000000 2021-11-22 00:16:11,592 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:11,594 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:12,986 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3705.000000 2021-11-22 00:16:12,992 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:12,992 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:14,446 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3663.700000 2021-11-22 00:16:14,451 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:14,453 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:15,928 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3663.700000 2021-11-22 00:16:15,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:15,934 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:17,427 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3663.700000 2021-11-22 00:16:17,433 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:17,434 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:18,881 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3663.700000 2021-11-22 00:16:18,887 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:18,887 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:20,361 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3663.700000 2021-11-22 00:16:20,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:20,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:21,775 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3642.000000 2021-11-22 00:16:21,780 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:21,782 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:23,190 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3642.000000 2021-11-22 00:16:23,196 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:23,196 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:24,724 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3650.500000 2021-11-22 00:16:24,732 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:24,732 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:26,167 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3650.500000 2021-11-22 00:16:26,173 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:26,174 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:27,686 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3650.500000 2021-11-22 00:16:27,690 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:27,691 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:29,104 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3650.500000 2021-11-22 00:16:29,108 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:29,108 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:30,510 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3650.500000 2021-11-22 00:16:30,516 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:30,516 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:31,950 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3660.600000 2021-11-22 00:16:31,956 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:31,957 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:33,079 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21' completed 2021-11-22 00:16:33,081 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21 are 22000 2021-11-22 00:16:33,082 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2288000 to 2310000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21 2021-11-22 00:16:33,082 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21 2021-11-22 00:16:33,198 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21' completed 2021-11-22 00:16:33,200 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21 are 22000 2021-11-22 00:16:33,200 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2310000 to 2332000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21 2021-11-22 00:16:33,200 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21 2021-11-22 00:16:33,362 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3660.600000 2021-11-22 00:16:33,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:33,368 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:33,951 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21' completed 2021-11-22 00:16:33,953 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21 are 22000 2021-11-22 00:16:33,953 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2332000 to 2354000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21 2021-11-22 00:16:33,954 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21 2021-11-22 00:16:34,065 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21' completed 2021-11-22 00:16:34,065 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21 are 22000 2021-11-22 00:16:34,066 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2354000 to 2376000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21 2021-11-22 00:16:34,066 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21 2021-11-22 00:16:34,290 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21' completed 2021-11-22 00:16:34,678 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21' completed 2021-11-22 00:16:34,776 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21' completed 2021-11-22 00:16:34,778 | test | DEBUG | pool-3-thread-15 | [task:record_bucket_ops:3570] Ops rate for 'default': 3613.800000 2021-11-22 00:16:34,783 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> call():L3615 2021-11-22 00:16:34,783 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:16:34,867 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21' completed 2021-11-22 00:16:34,882 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21' completed 2021-11-22 00:16:34,887 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21' completed 2021-11-22 00:16:34,894 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21' completed 2021-11-22 00:16:34,982 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21' completed 2021-11-22 00:16:34,983 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21 are 22000 2021-11-22 00:16:34,983 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2376000 to 2398000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21 2021-11-22 00:16:34,983 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21 2021-11-22 00:16:35,020 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21' completed 2021-11-22 00:16:35,020 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21' completed 2021-11-22 00:16:35,022 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21 are 22000 2021-11-22 00:16:35,023 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2398000 to 2420000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21 2021-11-22 00:16:35,023 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21 2021-11-22 00:16:35,023 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21 are 22000 2021-11-22 00:16:35,023 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2420000 to 2442000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21 2021-11-22 00:16:35,025 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21 2021-11-22 00:16:35,025 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21 are 22000 2021-11-22 00:16:35,026 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2442000 to 2464000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21 2021-11-22 00:16:35,026 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21 2021-11-22 00:16:35,026 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21 are 22000 2021-11-22 00:16:35,028 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2464000 to 2486000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21 2021-11-22 00:16:35,028 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21 2021-11-22 00:16:35,029 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21 are 22000 2021-11-22 00:16:35,029 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2486000 to 2508000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21 2021-11-22 00:16:35,029 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21 2021-11-22 00:16:35,029 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21 are 22000 2021-11-22 00:16:35,030 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2508000 to 2530000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21 2021-11-22 00:16:35,030 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21 2021-11-22 00:16:35,032 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21 are 22000 2021-11-22 00:16:35,032 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2530000 to 2552000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21 2021-11-22 00:16:35,032 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21 2021-11-22 00:16:35,032 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21 are 22000 2021-11-22 00:16:35,033 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2552000 to 2574000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21 2021-11-22 00:16:35,035 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21 2021-11-22 00:16:35,049 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21' completed 2021-11-22 00:16:35,302 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21' completed 2021-11-22 00:16:35,303 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21 are 22000 2021-11-22 00:16:35,305 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2574000 to 2596000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21 2021-11-22 00:16:35,305 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21 2021-11-22 00:16:35,305 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21 are 22000 2021-11-22 00:16:35,306 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2596000 to 2618000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21 2021-11-22 00:16:35,306 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21 2021-11-22 00:16:35,308 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3886] Items loaded in task LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21 are 22000 2021-11-22 00:16:35,308 | test | DEBUG | pool-3-thread-4 | [task:execute_tasks:3915] Failed to load 0 docs from 2618000 to 2640000 of thread_name LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21 2021-11-22 00:16:35,309 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637567863.21 2021-11-22 00:16:35,806 | test | INFO | pool-3-thread-15 | [table_view:display:72] Ops trend for bucket 'default' +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ | 1556.200 | ......................******..................*..................................*****...............**......****X | 6526.100 | | 6505.500 | ...............................................................................................X | 6505.500 | | 6445.100 | ..............................................................................................*****X | 6445.100 | | 6441.100 | ..............................................................................................X | 6441.100 | | 6332.800 | .............................................................................................****X | 6332.800 | | 6106.300 | .........................................................................................**.*****...X | 6332.100 | | 6244.200 | ...........................................................................................****X | 6244.200 | | 6242.900 | ...........................................................................................**..*****...*...*****X | 6734.200 | | 6675.700 | ..................................................................................................X | 6675.700 | | 6587.400 | ................................................................................................****X | 6587.400 | | 6250.300 | ...........................................................................................X | 6250.300 | | 5846.000 | .....................................................................................*****X | 5846.000 | | 5844.300 | .....................................................................................*...*****..**.****X | 6260.200 | | 6034.400 | ........................................................................................X | 6034.400 | | 5842.700 | .....................................................................................****X | 5842.700 | | 5830.300 | .....................................................................................*X | 5830.300 | | 5818.700 | .....................................................................................******..*****...**.*****..*..****X | 6476.900 | | 6468.900 | ...............................................................................................**.*****X | 6541.800 | | 6442.700 | ..............................................................................................*****X | 6442.700 | | 6336.300 | .............................................................................................X | 6336.300 | | 6189.700 | ..........................................................................................****X | 6189.700 | | 6168.200 | ..........................................................................................*.******..X | 6343.800 | | 6342.400 | .............................................................................................****X | 6342.400 | | 6242.800 | ...........................................................................................**.****X | 6280.000 | | 6253.800 | ...........................................................................................X | 6253.800 | | 6024.300 | ........................................................................................*****X | 6024.300 | | 6013.000 | ........................................................................................*..*****.*..*****X | 6392.600 | | 6317.900 | ............................................................................................X | 6317.900 | | 6200.600 | ...........................................................................................****X | 6200.600 | | 6197.900 | ...........................................................................................******X | 6211.000 | | 6170.800 | ..........................................................................................X | 6170.800 | | 6036.600 | ........................................................................................***********X | 6050.500 | | 6012.500 | ........................................................................................X | 6012.500 | | 5992.400 | .......................................................................................****X | 5992.400 | | 5926.600 | .......................................................................................*******...*..*****X | 6276.300 | | 6269.900 | ............................................................................................X | 6269.900 | | 6204.500 | ...........................................................................................****X | 6204.500 | | 6203.500 | ...........................................................................................******X | 6242.300 | | 5915.000 | ......................................................................................X | 5915.000 | | 5529.400 | .................................................................................*****..**..*****.*..*****X | 6031.500 | | 5998.200 | ........................................................................................X | 5998.200 | | 5920.600 | ......................................................................................****X | 5920.600 | | 5884.200 | ......................................................................................*******.X | 5934.800 | | 5873.700 | ......................................................................................****X | 5873.700 | | 5846.100 | .....................................................................................**.******..*****X | 6016.600 | | 5927.400 | .......................................................................................X | 5927.400 | | 5703.700 | ...................................................................................****X | 5703.700 | | 5547.900 | .................................................................................X | 5547.900 | | 5447.300 | ...............................................................................****X | 5447.300 | | 5346.400 | ..............................................................................*X | 5346.400 | | 5235.900 | ............................................................................****X | 5235.900 | | 4883.500 | .......................................................................X | 4883.500 | | 4560.500 | ..................................................................****X | 4560.500 | | 4539.500 | ..................................................................X | 4539.500 | | 4407.700 | ................................................................*****X | 4407.700 | | 4237.900 | .............................................................X | 4237.900 | | 4150.000 | ............................................................*****..*....******...*..****X | 4870.700 | | 4801.500 | ......................................................................X | 4801.500 | | 4721.700 | .....................................................................*****X | 4721.700 | | 4580.100 | ...................................................................******......**....****X | 5313.300 | | 5059.400 | ..........................................................................X | 5059.400 | | 4772.400 | .....................................................................*****.....**......****X | 5485.200 | | 4396.100 | ................................................................X | 4396.100 | | 3125.100 | .............................................******......*........*****.....**.......*****...*.****X | 5132.100 | | 5080.800 | ..........................................................................*X | 5080.800 | | 5039.700 | .........................................................................****X | 5039.700 | | 4687.200 | ....................................................................X | 4687.200 | | 4341.600 | ...............................................................*****..**..*****...*....*****X | 5051.700 | | 4966.700 | ........................................................................X | 4966.700 | | 4930.400 | ........................................................................*****.**.*****...*..******.******.**..****X | 5687.000 | | 5629.400 | ..................................................................................*X | 5629.400 | | 5571.300 | .................................................................................****X | 5571.300 | | 5472.200 | ................................................................................X | 5472.200 | | 5326.500 | ..............................................................................****X | 5326.500 | | 5266.100 | .............................................................................**.*****..******X | 5497.400 | | 5447.400 | ...............................................................................X | 5447.400 | | 5379.900 | ..............................................................................****X | 5379.900 | | 5265.100 | .............................................................................*X | 5265.100 | | 5189.000 | ............................................................................******X | 5216.900 | | 5155.700 | ...........................................................................****X | 5155.700 | | 5065.800 | ..........................................................................******X | 5091.000 | | 5042.600 | .........................................................................X | 5042.600 | | 4936.700 | ........................................................................****X | 4936.700 | | 4704.300 | ....................................................................*X | 4704.300 | | 4463.300 | .................................................................*****..**....*****.X | 4925.500 | | 4864.700 | .......................................................................*****X | 4864.700 | | 4858.800 | .......................................................................*.******X | 4966.700 | | 4952.500 | ........................................................................****X | 4952.500 | | 4933.400 | ........................................................................*X | 4933.400 | | 4917.300 | ........................................................................*******.****X | 4989.000 | | 4954.900 | ........................................................................X | 4954.900 | | 4916.000 | ........................................................................*****X | 4916.000 | | 4913.000 | .......................................................................*.******X | 4957.500 | | 4946.200 | ........................................................................*****X | 4946.200 | | 4935.500 | ........................................................................*****X | 4966.900 | | 4957.700 | ........................................................................*X | 4957.700 | | 4902.600 | .......................................................................****X | 4902.600 | | 4822.400 | ......................................................................X | 4822.400 | | 4759.500 | .....................................................................******.*****X | 4782.100 | | 4773.400 | .....................................................................**..****X | 4868.800 | | 4858.600 | .......................................................................X | 4858.600 | | 4694.900 | ....................................................................*****X | 4694.900 | | 4599.000 | ...................................................................X | 4599.000 | | 4559.600 | ..................................................................*****.**..***********X | 4755.900 | | 4741.300 | .....................................................................*****X | 4752.500 | | 4718.800 | .....................................................................X | 4718.800 | | 4713.300 | ....................................................................******.X | 4730.300 | | 4684.700 | ....................................................................*****.**.*****X | 4804.700 | | 4743.800 | .....................................................................*****X | 4743.800 | | 4673.700 | ....................................................................X | 4673.700 | | 4625.700 | ...................................................................*****X | 4625.700 | | 4568.400 | ..................................................................X | 4568.400 | | 4507.900 | .................................................................****X | 4507.900 | | 4344.500 | ...............................................................*X | 4344.500 | | 4202.200 | .............................................................****X | 4202.200 | | 4160.000 | ............................................................X | 4160.000 | | 4094.700 | ...........................................................*****.******X | 4141.700 | | 4002.900 | ..........................................................X | 4002.900 | | 3806.500 | .......................................................*****X | 3806.500 | | 3729.500 | ......................................................*******.X | 3774.600 | | 3769.200 | ......................................................****X | 3769.200 | | 3705.000 | ......................................................*X | 3705.000 | | 3663.700 | .....................................................****X | 3663.700 | | 3642.000 | .....................................................********X | 3660.600 | | 3613.800 | ....................................................X | 3613.800 | +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ 2021-11-22 00:16:35,812 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637567863.21' completed 2021-11-22 00:16:35,813 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-22 00:16:35,813 | infra | WARNING | pool-3-thread-4 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637567862.94' not completed 2021-11-22 00:16:35,815 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3934] ====================================== 2021-11-22 00:16:35,815 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1056000_1082400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,815 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1056000_1082400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,815 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,816 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1082400_1108800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,816 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,818 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1082400_1108800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,818 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1108800_1135200_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,819 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1108800_1135200_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,819 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,819 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1135200_1161600_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,821 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1135200_1161600_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,821 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,822 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1161600_1188000_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,822 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1161600_1188000_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,822 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,822 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1188000_1214400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,823 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,823 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1188000_1214400_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,825 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1214400_1240800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,825 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,825 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1214400_1240800_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,826 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1240800_1267200_1637567863.03' complete. Loaded 26400 items 2021-11-22 00:16:35,826 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,828 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1240800_1267200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,828 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1267200_1293600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,828 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1267200_1293600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,829 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1293600_1320000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,831 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,831 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1293600_1320000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,832 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1320000_1346400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,832 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,832 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1320000_1346400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,832 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1346400_1372800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,832 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,834 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1346400_1372800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,834 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,835 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1372800_1399200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,835 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1372800_1399200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,835 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1399200_1425600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,836 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,836 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1399200_1425600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,838 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1425600_1452000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,838 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,838 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1425600_1452000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,838 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1452000_1478400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,838 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,839 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1452000_1478400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,841 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1478400_1504800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,841 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,842 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1478400_1504800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,842 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1504800_1531200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,842 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,842 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1504800_1531200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,844 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,844 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1531200_1557600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,845 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1531200_1557600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,845 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,845 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_update_NONE_1557600_1584000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,846 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_update_NONE_1557600_1584000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,846 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,848 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1056000_1082400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,848 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1082400_1108800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,848 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1108800_1135200_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,848 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1135200_1161600_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,848 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1161600_1188000_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,849 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1188000_1214400_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,849 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1214400_1240800_1637567863.04' complete. Loaded 26400 items 2021-11-22 00:16:35,851 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1240800_1267200_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,851 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1267200_1293600_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,851 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1293600_1320000_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,851 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1320000_1346400_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,855 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1346400_1372800_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,855 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1372800_1399200_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,855 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1399200_1425600_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,857 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1425600_1452000_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,858 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1452000_1478400_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,858 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1478400_1504800_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,858 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1504800_1531200_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,859 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1531200_1557600_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,861 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_update_NONE_1557600_1584000_1637567863.05' complete. Loaded 26400 items 2021-11-22 00:16:35,861 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_0_26400_1637567863.11' complete. Loaded 26400 items 2021-11-22 00:16:35,861 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_26400_52800_1637567863.11' complete. Loaded 26400 items 2021-11-22 00:16:35,862 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_52800_79200_1637567863.11' complete. Loaded 26400 items 2021-11-22 00:16:35,862 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_79200_105600_1637567863.11' complete. Loaded 26400 items 2021-11-22 00:16:35,864 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_105600_132000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,865 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_132000_158400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,865 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_158400_184800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,865 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_184800_211200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,865 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_211200_237600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,867 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_237600_264000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,867 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_264000_290400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,868 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_290400_316800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,868 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_316800_343200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,868 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_343200_369600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,868 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_369600_396000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,869 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_0_26400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,869 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_396000_422400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,871 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_26400_52800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,871 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_422400_448800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,871 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_448800_475200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,871 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_52800_79200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,872 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_79200_105600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,874 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_475200_501600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,874 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_delete_NONE_501600_528000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,875 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_105600_132000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,875 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,875 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_132000_158400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,877 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,877 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_158400_184800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,878 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,878 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_184800_211200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,878 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,880 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_211200_237600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,880 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_237600_264000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,881 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,881 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,881 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_264000_290400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,881 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,882 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_290400_316800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,882 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,884 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_316800_343200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,884 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_0_26400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,884 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,884 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_343200_369600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,885 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_26400_52800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,885 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_369600_396000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,887 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,887 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_52800_79200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,888 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,888 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_396000_422400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,888 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_79200_105600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,888 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,890 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_105600_132000_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,891 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_422400_448800_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,891 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,891 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_132000_158400_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,891 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_448800_475200_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,892 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.12' complete. Loaded 26400 items 2021-11-22 00:16:35,892 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_158400_184800_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,894 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_184800_211200_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,894 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,894 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_475200_501600_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,894 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_211200_237600_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,895 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,895 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_delete_NONE_501600_528000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,897 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,897 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_237600_264000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,898 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,898 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_264000_290400_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,898 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,898 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_290400_316800_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,900 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,900 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_316800_343200_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,901 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_343200_369600_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,901 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_369600_396000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,901 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_396000_422400_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,901 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_422400_448800_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,903 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_448800_475200_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,903 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_475200_501600_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,903 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_delete_NONE_501600_528000_1637567863.13' complete. Loaded 26400 items 2021-11-22 00:16:35,904 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,904 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2200000_2222000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,904 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,905 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2222000_2244000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,905 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,907 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2244000_2266000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,907 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,907 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2200000_2222000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,908 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2266000_2288000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,908 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,910 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2222000_2244000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,910 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2288000_2310000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,911 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2244000_2266000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,911 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,911 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2310000_2332000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,911 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2266000_2288000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,913 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,913 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2332000_2354000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,914 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2288000_2310000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,914 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,914 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2354000_2376000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,914 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2310000_2332000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,915 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,915 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2376000_2398000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,917 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2332000_2354000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,917 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,917 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2398000_2420000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,917 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2354000_2376000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,918 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,920 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2420000_2442000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,920 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2376000_2398000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,921 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,921 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2442000_2464000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,921 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2398000_2420000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,921 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,923 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2464000_2486000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,923 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2420000_2442000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,924 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2486000_2508000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,924 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2442000_2464000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,924 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,926 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2508000_2530000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,926 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2464000_2486000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,927 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,927 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2486000_2508000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,927 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2530000_2552000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,928 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,930 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2508000_2530000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,930 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2552000_2574000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,930 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,930 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2574000_2596000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,931 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2530000_2552000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,931 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,933 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2596000_2618000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,933 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2552000_2574000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,934 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,934 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection0_ttl=0_create_NONE_2618000_2640000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,934 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2574000_2596000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,936 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,936 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2596000_2618000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,937 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default__default__default_ttl=0_create_NONE_2618000_2640000_1637567863.2' complete. Loaded 22000 items 2021-11-22 00:16:35,937 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2200000_2222000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,937 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2222000_2244000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,937 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2244000_2266000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,938 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2266000_2288000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,938 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2288000_2310000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,940 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2310000_2332000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,940 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2332000_2354000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,940 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2354000_2376000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,941 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2376000_2398000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,941 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2398000_2420000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,941 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2420000_2442000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,943 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2442000_2464000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,944 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2464000_2486000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,944 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2486000_2508000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,944 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2508000_2530000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,944 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2530000_2552000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,946 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2552000_2574000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,947 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2574000_2596000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,947 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2596000_2618000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,947 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3937] Task 'LoadDocs_MutateDocsFromSpecTask_1637567862.94_default_Scope1_FunctionCollection1_ttl=0_create_NONE_2618000_2640000_1637567863.21' complete. Loaded 22000 items 2021-11-22 00:16:35,989 | infra | INFO | pool-3-thread-4 | [task_manager:add_new_task:22] Added new task: PrintBucketStats_default_1637568995.95 2021-11-22 00:16:35,989 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'PrintBucketStats_default_1637568995.95' started 2021-11-22 00:16:35,990 | infra | DEBUG | pool-3-thread-4 | [task_manager:get_task_result:25] Getting task result for PrintBucketStats_default_1637568995.95 2021-11-22 00:16:35,992 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'PrintBucketStats_default_1637568995.95' completed 2021-11-22 00:16:35,992 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3932] ========= Tasks in loadgen pool======= 2021-11-22 00:16:35,993 | infra | WARNING | pool-3-thread-4 | [task_manager:print_tasks_in_pool:82] Task 'MutateDocsFromSpecTask_1637567862.94' not completed 2021-11-22 00:16:35,993 | infra | DEBUG | pool-3-thread-4 | [task:execute_tasks:3934] ====================================== 2021-11-22 00:16:35,993 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'MutateDocsFromSpecTask_1637567862.94' completed 2021-11-22 00:16:36,164 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.223 port:8091 ssh_username:root, ip:172.23.105.208 port:8091 ssh_username:root] 2021-11-22 00:16:36,178 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-22 00:16:36,499 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 00:16:36,793 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-22 00:16:36,999 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 00:16:37,000 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-22 00:16:37,033 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-22 00:16:37,066 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-22 00:16:37,098 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-22 00:16:37,132 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-22 00:16:37,155 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-22 00:16:37,180 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-22 00:16:37,206 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-22 00:16:37,207 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637568997.21 2021-11-22 00:16:37,207 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637568997.21' started 2021-11-22 00:16:37,210 | infra | DEBUG | pool-3-thread-7 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-22 00:16:37,224 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-22 00:16:37,539 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 00:16:37,845 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-22 00:16:38,066 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 00:16:38,068 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-22 00:16:38,098 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-22 00:16:38,130 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-22 00:16:38,158 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-22 00:16:38,198 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-22 00:16:38,232 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-22 00:16:38,269 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-22 00:16:38,309 | infra | DEBUG | MainThread | [cluster:async_wait_for_stats:559] Starting StatsWaitTask for num_items_for_persistence on bucket default 2021-11-22 00:16:38,309 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: StatsWaitTask_default_num_items_for_persistence_1637568998.31 2021-11-22 00:16:38,311 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637568997.21 2021-11-22 00:16:38,311 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'StatsWaitTask_default_num_items_for_persistence_1637568998.31' started 2021-11-22 00:16:38,312 | infra | DEBUG | pool-3-thread-29 | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password -b default checkpoint 2021-11-22 00:16:40,003 | test | DEBUG | pool-3-thread-7 | [task:_compare:2725] Comparing 0 == 0 2021-11-22 00:16:40,005 | test | DEBUG | pool-3-thread-7 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.223': 0} for bucket 'default' 2021-11-22 00:16:40,006 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637568997.21' completed 2021-11-22 00:16:40,009 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-22 00:16:40,009 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for StatsWaitTask_default_num_items_for_persistence_1637568998.31 2021-11-22 00:16:41,371 | test | DEBUG | pool-3-thread-29 | [task:_compare:2725] Comparing 0 == 0 2021-11-22 00:16:41,371 | test | DEBUG | pool-3-thread-29 | [task:_get_checkpoint_stats_and_compare:2714] Ready: num_items_for_persistence 0 == 0. Received: {'172.23.105.208': 0} for bucket 'default' 2021-11-22 00:16:41,371 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'StatsWaitTask_default_num_items_for_persistence_1637568998.31' completed 2021-11-22 00:16:41,374 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-22 00:16:41,375 | test | DEBUG | MainThread | [plasma_stats:test_system_stability_with_indexer:668] Total items are 2112000.0 2021-11-22 00:16:41,377 | test | INFO | MainThread | [index_ready_functions:create_gsi_on_each_collection:59] Creating indexes with defer:1 build 2021-11-22 00:16:41,378 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-22 00:16:41,378 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default_FunctionCollection1_1 2021-11-22 00:16:41,410 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.38 2021-11-22 00:16:41,410 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.38' started 2021-11-22 00:16:41,411 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default__default_1` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-22 00:16:41,411 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default__default_1 2021-11-22 00:16:41,454 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_1` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.41' started 2021-11-22 00:16:41,454 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default__default_1` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.41 2021-11-22 00:16:41,456 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-22 00:16:41,457 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call 2021-11-22 00:16:41,457 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection1_1 2021-11-22 00:16:41,490 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 00:16:41,513 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.46 2021-11-22 00:16:41,513 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.46' started 2021-11-22 00:16:41,513 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 } 2021-11-22 00:16:41,513 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection0_1 2021-11-22 00:16:41,559 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call 2021-11-22 00:16:41,565 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.52 2021-11-22 00:16:41,565 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.52' started 2021-11-22 00:16:41,565 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.38 2021-11-22 00:16:41,605 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call 2021-11-22 00:16:41,842 | infra | DEBUG | pool-3-thread-21 | [task:call:6532] Status of the query 1 2021-11-22 00:16:41,842 | infra | INFO | pool-3-thread-21 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 00:16:41,844 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.52' completed 2021-11-22 00:16:42,513 | infra | DEBUG | pool-3-thread-20 | [task:call:6532] Status of the query 1 2021-11-22 00:16:42,513 | infra | INFO | pool-3-thread-20 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 00:16:42,515 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.46' completed 2021-11-22 00:17:41,749 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=CREATE+INDEX+%60default__default_FunctionCollection1_1%60+ON+%60default%60.%60_default%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+True%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "1de6107c-5d18-4ff2-ae2c-9bd4ccf93fe6", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index creation for index default__default_FunctionCollection1_1, bucket default, scope _default, collection FunctionCollection1 cannot start. Reason: Create index or Alter replica cannot proceed due to another concurrent create index request.. Scheduling of index creation was attempted. Please check for index status later."}], "status": "errors", "metrics": {"elapsedTime": "1m0.263045154s","executionTime": "1m0.248423286s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"errorCount": 1} } auth: Administrator:password 2021-11-22 00:17:41,749 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=CREATE+INDEX+%60default__default__default_1%60+ON+%60default%60.%60_default%60.%60_default%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+True%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "8ab40482-7eda-4075-ad3e-670bb5956970", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index creation for index default__default__default_1, bucket default, scope _default, collection _default cannot start. Reason: Create index or Alter replica cannot proceed due to another concurrent create index request.. Scheduling of index creation was attempted. Please check for index status later."}], "status": "errors", "metrics": {"elapsedTime": "1m0.219745334s","executionTime": "1m0.219590844s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"errorCount": 1} } auth: Administrator:password 2021-11-22 00:17:41,752 | infra | DEBUG | pool-3-thread-6 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 00:17:41,752 | infra | DEBUG | pool-3-thread-19 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 00:17:41,753 | infra | DEBUG | pool-3-thread-19 | [task:call:6532] Status of the query 0 2021-11-22 00:17:41,753 | infra | DEBUG | pool-3-thread-6 | [task:call:6532] Status of the query 0 2021-11-22 00:17:41,753 | infra | INFO | pool-3-thread-19 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 00:17:41,753 | infra | INFO | pool-3-thread-6 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 00:17:41,753 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_1` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.41' completed 2021-11-22 00:17:41,755 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.38' completed 2021-11-22 00:17:41,755 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default__default_1` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.41 2021-11-22 00:17:41,756 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.46 2021-11-22 00:17:41,756 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': True, 'num_replica': 0 }started1637569001.52 2021-11-22 00:17:41,901 | test | INFO | MainThread | [index_ready_functions:build_deferred_indexes:39] Building indexes 2021-11-22 00:17:41,901 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`_default`.`FunctionCollection1`(['default__default_FunctionCollection1_1']) USING GSI 2021-11-22 00:17:41,901 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60_default%60.%60FunctionCollection1%60%28%5B%27default__default_FunctionCollection1_1%27%5D%29+USING+GSI 2021-11-22 00:17:41,957 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'a7b433a0-8727-4e05-91cf-41981d5ec152', u'metrics': {u'resultCount': 0, u'executionTime': u'38.647765ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'38.776425ms'}, u'results': [], u'status': u'success'} 2021-11-22 00:17:41,957 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`_default`.`_default`(['default__default__default_1']) USING GSI 2021-11-22 00:17:41,959 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60_default%60.%60_default%60%28%5B%27default__default__default_1%27%5D%29+USING+GSI 2021-11-22 00:17:42,039 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'd9017aa1-e39e-465e-9582-7e21c3647389', u'metrics': {u'resultCount': 0, u'executionTime': u'54.181127ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'64.250534ms'}, u'results': [], u'status': u'success'} 2021-11-22 00:17:42,039 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`Scope1`.`FunctionCollection1`(['default_Scope1_FunctionCollection1_1']) USING GSI 2021-11-22 00:17:42,039 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60Scope1%60.%60FunctionCollection1%60%28%5B%27default_Scope1_FunctionCollection1_1%27%5D%29+USING+GSI 2021-11-22 00:17:42,085 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'60c33d49-b456-488b-823d-2729c1455c25', u'metrics': {u'resultCount': 0, u'executionTime': u'28.835739ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'29.108261ms'}, u'results': [], u'status': u'success'} 2021-11-22 00:17:42,085 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:47] Query is: BUILD INDEX on `default`.`Scope1`.`FunctionCollection0`(['default_Scope1_FunctionCollection0_1']) USING GSI 2021-11-22 00:17:42,086 | test | DEBUG | MainThread | [rest_client:query_tool:2916] Query params: statement=BUILD+INDEX+on+%60default%60.%60Scope1%60.%60FunctionCollection0%60%28%5B%27default_Scope1_FunctionCollection0_1%27%5D%29+USING+GSI 2021-11-22 00:17:42,131 | test | DEBUG | MainThread | [index_ready_functions:build_deferred_indexes:50] Json load for deferred build is: {u'signature': None, u'requestID': u'01d1ccd2-a9d4-4e0d-a975-09129790ec77', u'metrics': {u'resultCount': 0, u'executionTime': u'27.311752ms', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'27.421161ms'}, u'results': [], u'status': u'success'} 2021-11-22 00:17:42,132 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-22 00:17:42,167 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default_FunctionCollection1_1 2021-11-22 00:17:42,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:42,224 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:43,224 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 0 2021-11-22 00:17:43,282 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:43,282 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:44,282 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 1 2021-11-22 00:17:44,341 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:44,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:45,342 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 2 2021-11-22 00:17:45,401 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:45,401 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:46,403 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 3 2021-11-22 00:17:46,464 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:46,464 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:47,466 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 4 2021-11-22 00:17:47,536 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:47,536 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:48,536 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 5 2021-11-22 00:17:48,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:48,592 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:49,594 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 6 2021-11-22 00:17:49,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:49,645 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:50,647 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 7 2021-11-22 00:17:50,710 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:50,710 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:51,711 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 8 2021-11-22 00:17:51,769 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:51,769 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:52,769 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 9 2021-11-22 00:17:52,826 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:52,828 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:53,828 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 10 2021-11-22 00:17:53,884 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:53,885 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:54,885 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 11 2021-11-22 00:17:54,947 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:54,948 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:55,950 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 12 2021-11-22 00:17:56,006 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:56,006 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:57,007 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 13 2021-11-22 00:17:57,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:57,073 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:58,073 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 14 2021-11-22 00:17:58,128 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:58,128 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:17:59,128 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 15 2021-11-22 00:17:59,190 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:17:59,191 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:00,191 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 16 2021-11-22 00:18:00,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:00,250 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:01,252 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 17 2021-11-22 00:18:01,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:01,315 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:02,316 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 18 2021-11-22 00:18:02,384 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:02,384 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:03,384 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 19 2021-11-22 00:18:03,441 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:03,441 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:04,443 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 20 2021-11-22 00:18:04,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:04,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:05,502 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 21 2021-11-22 00:18:05,568 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:05,569 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:06,569 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 22 2021-11-22 00:18:06,638 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:06,638 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:07,640 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 23 2021-11-22 00:18:07,698 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:07,698 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:08,700 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 24 2021-11-22 00:18:08,759 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:08,760 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:09,762 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 25 2021-11-22 00:18:09,816 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:09,816 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:10,818 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 26 2021-11-22 00:18:10,882 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:10,884 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:11,884 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 27 2021-11-22 00:18:11,938 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:11,940 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:12,940 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 28 2021-11-22 00:18:12,999 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:13,000 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:14,000 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 29 2021-11-22 00:18:14,065 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:14,066 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:15,068 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 30 2021-11-22 00:18:15,124 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:15,125 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:16,125 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 31 2021-11-22 00:18:16,183 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:16,184 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:17,184 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 32 2021-11-22 00:18:17,246 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:17,246 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:18,247 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 33 2021-11-22 00:18:18,308 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:18,309 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:19,309 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 34 2021-11-22 00:18:19,365 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:19,367 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:20,368 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 35 2021-11-22 00:18:20,430 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:20,430 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:21,431 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 36 2021-11-22 00:18:21,490 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:21,490 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:22,492 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 37 2021-11-22 00:18:22,552 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:22,552 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:23,552 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 38 2021-11-22 00:18:23,608 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:23,608 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:24,609 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 39 2021-11-22 00:18:24,690 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:24,690 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:25,690 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 40 2021-11-22 00:18:25,753 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:25,755 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:26,756 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 41 2021-11-22 00:18:26,818 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:26,818 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:27,819 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 42 2021-11-22 00:18:27,878 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:27,878 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:28,880 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 43 2021-11-22 00:18:28,934 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:28,934 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:29,936 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 44 2021-11-22 00:18:29,986 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:29,987 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:30,989 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 45 2021-11-22 00:18:31,028 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:31,029 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:32,029 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 46 2021-11-22 00:18:32,141 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:32,141 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:33,142 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 47 2021-11-22 00:18:33,198 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:33,200 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:34,200 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 48 2021-11-22 00:18:34,260 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:34,262 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:35,263 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 49 2021-11-22 00:18:35,313 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:35,315 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:36,315 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 50 2021-11-22 00:18:36,371 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:36,372 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:37,374 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 51 2021-11-22 00:18:37,427 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:37,428 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:38,430 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 52 2021-11-22 00:18:38,482 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:38,483 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:39,483 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 53 2021-11-22 00:18:39,529 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:39,529 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:40,529 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 54 2021-11-22 00:18:40,588 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:40,589 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:41,589 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 55 2021-11-22 00:18:41,647 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:41,648 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:42,648 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 56 2021-11-22 00:18:42,700 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:42,700 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:43,700 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 57 2021-11-22 00:18:43,753 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:43,755 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:44,756 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 58 2021-11-22 00:18:44,816 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:44,818 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:45,819 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 59 2021-11-22 00:18:45,884 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:45,885 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:46,887 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 60 2021-11-22 00:18:46,938 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:46,938 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:47,940 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 61 2021-11-22 00:18:48,003 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:48,003 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:49,005 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 62 2021-11-22 00:18:49,065 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:49,066 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:50,068 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 63 2021-11-22 00:18:50,127 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:50,127 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:51,128 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 64 2021-11-22 00:18:51,188 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:51,190 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:52,190 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 65 2021-11-22 00:18:52,243 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:52,244 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:53,246 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 66 2021-11-22 00:18:53,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:53,298 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:54,299 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 67 2021-11-22 00:18:54,361 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:54,361 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:55,361 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 68 2021-11-22 00:18:55,424 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:55,426 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:56,426 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 69 2021-11-22 00:18:56,487 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:56,487 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:57,489 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 70 2021-11-22 00:18:57,542 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:57,542 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:58,543 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 71 2021-11-22 00:18:58,598 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:58,599 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:18:59,601 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 72 2021-11-22 00:18:59,654 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:18:59,654 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:00,654 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 73 2021-11-22 00:19:00,707 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:00,707 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:01,709 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 74 2021-11-22 00:19:01,772 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:01,772 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:02,773 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 75 2021-11-22 00:19:02,828 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:02,828 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:03,829 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 76 2021-11-22 00:19:03,892 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:03,894 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:04,894 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 77 2021-11-22 00:19:04,953 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:04,953 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:05,954 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 78 2021-11-22 00:19:06,020 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:06,020 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:07,022 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 79 2021-11-22 00:19:07,085 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:07,086 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:08,088 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 80 2021-11-22 00:19:08,153 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:08,154 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:09,154 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 81 2021-11-22 00:19:09,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:09,298 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:10,299 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 82 2021-11-22 00:19:10,362 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:10,364 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:11,365 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 83 2021-11-22 00:19:11,421 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:11,423 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:12,424 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 84 2021-11-22 00:19:12,483 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:12,483 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:13,484 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 85 2021-11-22 00:19:13,540 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:13,542 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:14,542 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 86 2021-11-22 00:19:14,608 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:14,609 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:15,611 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 87 2021-11-22 00:19:15,690 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:15,691 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:16,693 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 88 2021-11-22 00:19:16,763 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:16,763 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:17,765 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 89 2021-11-22 00:19:17,828 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:17,828 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:18,828 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 90 2021-11-22 00:19:18,887 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:18,888 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:19,888 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 91 2021-11-22 00:19:19,954 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:19,954 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:20,956 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 92 2021-11-22 00:19:21,013 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:21,013 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:22,015 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 93 2021-11-22 00:19:22,078 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:22,078 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:23,079 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 94 2021-11-22 00:19:23,151 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:23,151 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:24,153 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 95 2021-11-22 00:19:24,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:24,224 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:25,226 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 96 2021-11-22 00:19:25,279 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:25,280 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:26,282 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 97 2021-11-22 00:19:26,335 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:26,336 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:27,338 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 98 2021-11-22 00:19:27,404 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:27,404 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:28,405 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 99 2021-11-22 00:19:28,466 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:28,467 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:29,467 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 100 2021-11-22 00:19:29,523 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:29,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:30,525 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 101 2021-11-22 00:19:30,582 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:30,582 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:31,582 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 102 2021-11-22 00:19:31,641 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:31,641 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:32,641 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 103 2021-11-22 00:19:32,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:32,714 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:33,716 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 104 2021-11-22 00:19:33,782 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:33,782 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:34,783 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 105 2021-11-22 00:19:34,848 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:34,848 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:35,849 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 106 2021-11-22 00:19:35,914 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:35,915 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:36,917 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 107 2021-11-22 00:19:36,990 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:36,990 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:37,992 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 108 2021-11-22 00:19:38,069 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:38,069 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:39,071 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 109 2021-11-22 00:19:39,137 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:39,138 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:40,138 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 110 2021-11-22 00:19:40,201 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:40,203 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:41,203 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 111 2021-11-22 00:19:41,259 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:41,259 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:42,260 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 112 2021-11-22 00:19:42,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:42,316 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:43,318 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 113 2021-11-22 00:19:43,392 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:43,392 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:44,394 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 114 2021-11-22 00:19:44,457 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:44,457 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:45,460 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 115 2021-11-22 00:19:45,529 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:45,530 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:46,532 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 116 2021-11-22 00:19:46,607 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:46,608 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:47,608 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 117 2021-11-22 00:19:47,667 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:47,667 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:48,670 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 118 2021-11-22 00:19:48,733 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:48,733 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:49,734 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 119 2021-11-22 00:19:49,803 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:49,803 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:50,805 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 120 2021-11-22 00:19:50,871 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:50,871 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:51,872 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 121 2021-11-22 00:19:51,927 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:51,928 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:52,930 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 122 2021-11-22 00:19:52,983 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:52,983 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:53,984 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 123 2021-11-22 00:19:54,048 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:54,049 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:55,049 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 124 2021-11-22 00:19:55,109 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:55,111 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:56,111 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 125 2021-11-22 00:19:56,170 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:56,171 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:57,171 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 126 2021-11-22 00:19:57,236 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:57,236 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:58,237 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 127 2021-11-22 00:19:58,302 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:58,303 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:19:59,305 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 128 2021-11-22 00:19:59,378 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:19:59,380 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:00,381 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 129 2021-11-22 00:20:00,440 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:00,441 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:01,443 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 130 2021-11-22 00:20:01,499 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:01,499 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:02,500 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 131 2021-11-22 00:20:02,562 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:02,562 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:03,562 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 132 2021-11-22 00:20:03,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:03,645 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:04,647 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 133 2021-11-22 00:20:04,704 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:04,706 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:05,707 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 134 2021-11-22 00:20:05,762 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:05,763 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:06,763 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 135 2021-11-22 00:20:06,819 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:06,821 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:07,822 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 136 2021-11-22 00:20:07,890 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:07,891 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:08,891 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 137 2021-11-22 00:20:08,950 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:08,951 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:09,951 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 138 2021-11-22 00:20:10,029 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:10,030 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:11,032 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 139 2021-11-22 00:20:11,086 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:11,086 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:12,088 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 140 2021-11-22 00:20:12,144 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:12,144 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:13,145 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 141 2021-11-22 00:20:13,207 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:13,209 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:14,209 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 142 2021-11-22 00:20:14,255 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:14,256 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:15,256 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 143 2021-11-22 00:20:15,312 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:15,312 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:16,313 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 144 2021-11-22 00:20:16,372 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:16,374 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:17,375 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 145 2021-11-22 00:20:17,427 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:17,428 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:18,430 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 146 2021-11-22 00:20:18,484 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:18,486 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:19,486 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 147 2021-11-22 00:20:19,542 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:19,542 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:20,543 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_1 not found with iteration 148 2021-11-22 00:20:20,589 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-22 00:20:20,628 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default__default_1 2021-11-22 00:20:20,681 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:20,681 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:21,683 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 0 2021-11-22 00:20:21,742 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:21,743 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:22,743 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 1 2021-11-22 00:20:22,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:22,802 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:23,803 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 2 2021-11-22 00:20:23,858 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:23,859 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:24,861 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 3 2021-11-22 00:20:24,921 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:24,921 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:25,921 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 4 2021-11-22 00:20:25,977 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:25,979 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:26,980 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 5 2021-11-22 00:20:27,032 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:27,033 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:28,035 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 6 2021-11-22 00:20:28,088 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:28,089 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:29,091 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 7 2021-11-22 00:20:29,147 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:29,148 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:30,148 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 8 2021-11-22 00:20:30,206 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:30,207 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:31,207 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 9 2021-11-22 00:20:31,270 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:31,270 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:32,272 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 10 2021-11-22 00:20:32,331 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:32,332 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:33,332 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 11 2021-11-22 00:20:33,400 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:33,400 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:34,401 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 12 2021-11-22 00:20:34,454 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:34,456 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:35,456 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 13 2021-11-22 00:20:35,510 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:35,512 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:36,513 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 14 2021-11-22 00:20:36,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:36,573 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:37,575 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 15 2021-11-22 00:20:37,631 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:37,632 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:38,632 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 16 2021-11-22 00:20:38,688 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:38,690 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:39,690 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 17 2021-11-22 00:20:39,744 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:39,744 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:40,746 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 18 2021-11-22 00:20:40,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:40,802 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:41,803 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 19 2021-11-22 00:20:41,862 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:41,864 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:42,865 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 20 2021-11-22 00:20:42,927 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:42,927 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:43,928 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 21 2021-11-22 00:20:43,987 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:43,987 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:44,989 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 22 2021-11-22 00:20:45,048 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:45,049 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:46,049 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 23 2021-11-22 00:20:46,111 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:46,111 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:47,112 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 24 2021-11-22 00:20:47,171 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:47,171 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:48,173 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 25 2021-11-22 00:20:48,232 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:48,233 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:49,233 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 26 2021-11-22 00:20:49,289 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:49,290 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:50,292 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 27 2021-11-22 00:20:50,348 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:50,348 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:51,349 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 28 2021-11-22 00:20:51,407 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:51,408 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:52,408 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 29 2021-11-22 00:20:52,467 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:52,467 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:53,467 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 30 2021-11-22 00:20:53,526 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:53,526 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:54,528 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 31 2021-11-22 00:20:54,581 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:54,582 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:55,582 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 32 2021-11-22 00:20:55,640 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:55,641 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:56,641 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 33 2021-11-22 00:20:56,703 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:56,703 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:57,704 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 34 2021-11-22 00:20:57,769 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:57,769 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:58,770 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 35 2021-11-22 00:20:58,835 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:58,835 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:20:59,836 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 36 2021-11-22 00:20:59,891 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:20:59,891 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:00,892 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 37 2021-11-22 00:21:00,957 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:00,957 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:01,959 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 38 2021-11-22 00:21:02,023 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:02,025 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:03,026 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 39 2021-11-22 00:21:03,086 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:03,088 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:04,088 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 40 2021-11-22 00:21:04,158 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:04,160 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:05,160 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 41 2021-11-22 00:21:05,220 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:05,220 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:06,220 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 42 2021-11-22 00:21:06,275 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:06,275 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:07,276 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 43 2021-11-22 00:21:07,341 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:07,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:08,342 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 44 2021-11-22 00:21:08,407 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:08,408 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:09,410 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 45 2021-11-22 00:21:09,467 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:09,467 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:10,469 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 46 2021-11-22 00:21:10,536 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:10,536 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:11,536 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 47 2021-11-22 00:21:11,599 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:11,601 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:12,601 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 48 2021-11-22 00:21:12,671 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:12,673 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:13,674 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 49 2021-11-22 00:21:13,729 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:13,729 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:14,730 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 50 2021-11-22 00:21:14,793 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:14,795 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:15,796 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 51 2021-11-22 00:21:15,855 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:15,855 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:16,857 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 52 2021-11-22 00:21:16,917 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:16,917 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:17,917 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 53 2021-11-22 00:21:17,974 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:17,976 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:18,976 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 54 2021-11-22 00:21:19,048 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:19,049 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:20,049 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 55 2021-11-22 00:21:20,105 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:20,105 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:21,107 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 56 2021-11-22 00:21:21,161 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:21,161 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:22,163 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 57 2021-11-22 00:21:22,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:22,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:23,223 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 58 2021-11-22 00:21:23,278 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:23,279 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:24,279 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 59 2021-11-22 00:21:24,335 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:24,335 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:25,336 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 60 2021-11-22 00:21:25,411 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:25,413 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:26,413 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 61 2021-11-22 00:21:26,463 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:26,464 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:27,466 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 62 2021-11-22 00:21:27,522 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:27,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:28,523 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 63 2021-11-22 00:21:28,575 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:28,575 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:29,575 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 64 2021-11-22 00:21:29,628 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:29,630 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:30,631 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 65 2021-11-22 00:21:30,690 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:30,690 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:31,691 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 66 2021-11-22 00:21:31,744 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:31,746 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:32,746 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 67 2021-11-22 00:21:32,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:32,803 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:33,805 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 68 2021-11-22 00:21:33,861 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:33,861 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:34,861 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 69 2021-11-22 00:21:34,996 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:34,997 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:35,999 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 70 2021-11-22 00:21:36,051 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:36,051 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:37,052 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 71 2021-11-22 00:21:37,111 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:37,112 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:38,114 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 72 2021-11-22 00:21:38,174 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:38,176 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:39,177 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 73 2021-11-22 00:21:39,230 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:39,230 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:40,232 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 74 2021-11-22 00:21:40,286 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:40,286 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:41,288 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 75 2021-11-22 00:21:41,345 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:41,345 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:42,346 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 76 2021-11-22 00:21:42,401 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:42,403 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:43,404 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 77 2021-11-22 00:21:43,460 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:43,461 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:44,463 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 78 2021-11-22 00:21:44,516 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:44,517 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:45,519 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 79 2021-11-22 00:21:45,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:45,572 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:46,573 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 80 2021-11-22 00:21:46,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:46,657 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:47,657 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 81 2021-11-22 00:21:47,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:47,713 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:48,714 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 82 2021-11-22 00:21:48,782 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:48,783 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:49,785 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 83 2021-11-22 00:21:49,839 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:49,841 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:50,842 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 84 2021-11-22 00:21:50,898 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:50,898 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:51,900 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 85 2021-11-22 00:21:51,953 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:51,953 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:52,953 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 86 2021-11-22 00:21:53,006 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:53,007 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:54,009 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 87 2021-11-22 00:21:54,065 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:54,065 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:55,066 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 88 2021-11-22 00:21:55,125 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:55,125 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:56,125 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 89 2021-11-22 00:21:56,177 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:56,177 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:57,178 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 90 2021-11-22 00:21:57,230 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:57,232 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:58,233 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 91 2021-11-22 00:21:58,289 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:58,289 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:21:59,290 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 92 2021-11-22 00:21:59,345 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:21:59,345 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:00,346 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 93 2021-11-22 00:22:00,401 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:00,401 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:01,401 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 94 2021-11-22 00:22:01,457 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:01,457 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:02,459 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 95 2021-11-22 00:22:02,510 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:02,512 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:03,512 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 96 2021-11-22 00:22:03,569 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:03,569 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:04,569 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 97 2021-11-22 00:22:04,628 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:04,628 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:05,630 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 98 2021-11-22 00:22:05,701 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:05,701 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:06,703 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 99 2021-11-22 00:22:06,753 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:06,753 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:07,755 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 100 2021-11-22 00:22:07,822 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:07,822 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:08,823 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 101 2021-11-22 00:22:08,881 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:08,882 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:09,884 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 102 2021-11-22 00:22:09,938 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:09,940 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:10,940 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 103 2021-11-22 00:22:10,990 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:10,990 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:11,992 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 104 2021-11-22 00:22:12,043 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:12,045 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:13,046 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 105 2021-11-22 00:22:13,098 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:13,099 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:14,101 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 106 2021-11-22 00:22:14,154 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:14,154 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:15,155 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 107 2021-11-22 00:22:15,214 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:15,216 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:16,217 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 108 2021-11-22 00:22:16,273 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:16,273 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:17,273 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 109 2021-11-22 00:22:17,328 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:17,328 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:18,328 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 110 2021-11-22 00:22:18,401 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:18,401 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:19,401 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 111 2021-11-22 00:22:19,454 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:19,454 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:20,456 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 112 2021-11-22 00:22:20,507 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:20,507 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:21,509 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 113 2021-11-22 00:22:21,562 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:21,563 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:22,565 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 114 2021-11-22 00:22:22,618 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:22,619 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:23,621 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 115 2021-11-22 00:22:23,677 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:23,677 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:24,678 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 116 2021-11-22 00:22:24,730 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:24,732 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:25,733 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 117 2021-11-22 00:22:25,785 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:25,786 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:26,786 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 118 2021-11-22 00:22:26,841 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:26,842 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:27,842 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 119 2021-11-22 00:22:27,894 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:27,895 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:28,897 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 120 2021-11-22 00:22:28,950 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:28,950 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:29,951 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 121 2021-11-22 00:22:30,010 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:30,010 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:31,012 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 122 2021-11-22 00:22:31,082 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:31,082 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:32,084 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 123 2021-11-22 00:22:32,134 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:32,135 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:33,137 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 124 2021-11-22 00:22:33,194 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:33,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:34,196 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 125 2021-11-22 00:22:34,249 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:34,249 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:35,250 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 126 2021-11-22 00:22:35,302 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:35,302 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:36,303 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 127 2021-11-22 00:22:36,358 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:36,359 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:37,361 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 128 2021-11-22 00:22:37,413 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:37,413 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:38,414 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 129 2021-11-22 00:22:38,469 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:38,469 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:39,470 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 130 2021-11-22 00:22:39,532 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:39,532 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:40,533 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 131 2021-11-22 00:22:40,584 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:40,585 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:41,585 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 132 2021-11-22 00:22:41,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:41,644 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:42,645 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 133 2021-11-22 00:22:42,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:42,713 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:43,714 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 134 2021-11-22 00:22:43,770 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:43,770 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:44,772 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 135 2021-11-22 00:22:44,825 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:44,825 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:45,826 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_1 not found with iteration 136 2021-11-22 00:22:45,861 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-22 00:22:45,900 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection1_1 2021-11-22 00:22:45,934 | test | INFO | MainThread | [index_ready_functions:wait_for_indexes_to_go_online:214] Waiting for indexes to go online 2021-11-22 00:22:45,971 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection0_1 2021-11-22 00:22:46,028 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:46,028 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:47,029 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 0 2021-11-22 00:22:47,082 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:47,082 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:48,084 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 1 2021-11-22 00:22:48,134 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:48,135 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:49,137 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 2 2021-11-22 00:22:49,193 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:49,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:50,194 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 3 2021-11-22 00:22:50,253 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:50,253 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:51,255 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 4 2021-11-22 00:22:51,312 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:51,312 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:52,313 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 5 2021-11-22 00:22:52,365 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:52,365 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:53,367 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 6 2021-11-22 00:22:53,424 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:53,424 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:54,424 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 7 2021-11-22 00:22:54,486 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:54,486 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:55,487 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 8 2021-11-22 00:22:55,549 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:55,551 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:56,552 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 9 2021-11-22 00:22:56,601 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:56,602 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:57,604 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 10 2021-11-22 00:22:57,655 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:57,655 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:58,657 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 11 2021-11-22 00:22:58,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:58,713 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:22:59,714 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 12 2021-11-22 00:22:59,772 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:22:59,773 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:00,773 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 13 2021-11-22 00:23:00,826 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:00,826 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:01,828 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 14 2021-11-22 00:23:01,882 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:01,882 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:02,884 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 15 2021-11-22 00:23:02,941 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:02,943 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:03,944 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 16 2021-11-22 00:23:04,003 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:04,003 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:05,003 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 17 2021-11-22 00:23:05,061 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:05,061 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:06,062 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 18 2021-11-22 00:23:06,127 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:06,128 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:07,128 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 19 2021-11-22 00:23:07,184 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:07,186 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:08,187 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 20 2021-11-22 00:23:08,243 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:08,243 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:09,243 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 21 2021-11-22 00:23:09,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:09,296 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:10,298 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 22 2021-11-22 00:23:10,348 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:10,348 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:11,348 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 23 2021-11-22 00:23:11,387 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:11,388 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:12,388 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 24 2021-11-22 00:23:12,438 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:12,438 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:13,440 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 25 2021-11-22 00:23:13,494 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:13,496 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:14,496 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 26 2021-11-22 00:23:14,548 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:14,549 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:15,549 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 27 2021-11-22 00:23:15,605 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:15,605 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:16,605 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 28 2021-11-22 00:23:16,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:16,657 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:17,657 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 29 2021-11-22 00:23:17,709 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:17,710 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:18,710 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 30 2021-11-22 00:23:18,767 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:18,767 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:19,769 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 31 2021-11-22 00:23:19,828 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:19,828 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:20,828 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 32 2021-11-22 00:23:20,882 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:20,882 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:21,884 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 33 2021-11-22 00:23:21,937 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:21,937 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:22,938 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 34 2021-11-22 00:23:22,993 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:22,993 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:23,993 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 35 2021-11-22 00:23:24,051 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:24,052 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:25,052 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 36 2021-11-22 00:23:25,107 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 00:23:25,107 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 00:23:26,108 | test | INFO | MainThread | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_1 not found with iteration 37 2021-11-22 00:23:26,141 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:234] Limit is 50000 and total Count is 2112000.0 2021-11-22 00:23:26,141 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0 2021-11-22 00:23:26,141 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 0 2021-11-22 00:23:26,181 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637569406.14 2021-11-22 00:23:26,181 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637569406.14' started 2021-11-22 00:23:26,181 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:23:26,183 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000 2021-11-22 00:23:26,183 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 50000 2021-11-22 00:23:26,219 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637569406.18 2021-11-22 00:23:26,220 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637569406.18' started 2021-11-22 00:23:26,220 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:23:26,220 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000 2021-11-22 00:23:26,220 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 100000 2021-11-22 00:23:26,223 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call 2021-11-22 00:23:26,259 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 00:23:26,259 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637569406.22 2021-11-22 00:23:26,260 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637569406.22' started 2021-11-22 00:23:26,260 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:23:26,260 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:23:26,262 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637569406.14 2021-11-22 00:23:26,301 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call 2021-11-22 00:28:26,230 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 00:28:26,233 | infra | INFO | pool-3-thread-1 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 00:28:26,233 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637569406.14' completed 2021-11-22 00:28:26,234 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637569406.18 2021-11-22 00:28:26,265 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 00:28:26,266 | infra | INFO | pool-3-thread-24 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 00:28:26,266 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637569406.18' completed 2021-11-22 00:28:26,267 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637569406.22 2021-11-22 00:28:26,305 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 00:28:26,306 | infra | INFO | pool-3-thread-30 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 00:28:26,306 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637569406.22' completed 2021-11-22 00:28:26,308 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 00:28:26,309 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000 2021-11-22 00:28:26,309 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 150000 2021-11-22 00:28:26,346 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637569706.31 2021-11-22 00:28:26,346 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637569706.31' started 2021-11-22 00:28:26,346 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:28:26,348 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000 2021-11-22 00:28:26,348 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 200000 2021-11-22 00:28:26,401 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 00:28:26,684 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637569706.35 2021-11-22 00:28:26,684 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637569706.35' started 2021-11-22 00:28:26,686 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:28:26,687 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000 2021-11-22 00:28:26,687 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 250000 2021-11-22 00:28:26,746 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637569706.69 2021-11-22 00:28:26,746 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637569706.69' started 2021-11-22 00:28:26,747 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:28:26,749 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:28:26,749 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637569706.31 2021-11-22 00:28:26,799 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call 2021-11-22 00:28:26,994 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184372e type=client open_count=1 channel=[id: 0x1898b6ef, 0.0.0.0/0.0.0.0:49873] timeout=300.0>) 2021-11-22 00:28:59,956 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:28:59,963 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:28:59,963 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184372f type=client open_count=1 channel=[id: 0x52693b45, 0.0.0.0/0.0.0.0:57312] timeout=300.0>) 2021-11-22 00:29:02,970 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:29:02,980 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:29:02,982 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843730 type=client open_count=1 channel=[id: 0x5bdf9ad3, 0.0.0.0/0.0.0.0:51357] timeout=300.0>) 2021-11-22 00:31:31,693 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:31:31,703 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:31:31,703 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 00:33:27,002 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 00:33:27,003 | infra | INFO | pool-3-thread-25 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 00:33:27,003 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637569706.35' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843731 type=client open_count=1 channel=[id: 0x360c9da4, 0.0.0.0/0.0.0.0:44410] timeout=300.0>) 2021-11-22 00:33:37,877 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:33:37,878 | infra | INFO | pool-3-thread-28 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 00:33:37,878 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637569706.31' completed 2021-11-22 00:33:37,878 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637569706.35 2021-11-22 00:33:37,880 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637569706.69 2021-11-22 00:34:05,986 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 00:34:05,987 | infra | INFO | pool-3-thread-23 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 00:34:05,989 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637569706.69' completed 2021-11-22 00:34:05,990 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 00:34:05,990 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000 2021-11-22 00:34:05,990 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 300000 2021-11-22 00:34:06,045 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637570045.99 2021-11-22 00:34:06,045 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637570045.99' started 2021-11-22 00:34:06,046 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:34:06,046 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000 2021-11-22 00:34:06,046 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 350000 2021-11-22 00:34:06,096 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call 2021-11-22 00:34:06,117 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637570046.05 2021-11-22 00:34:06,117 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637570046.05' started 2021-11-22 00:34:06,118 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:34:06,118 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000 2021-11-22 00:34:06,118 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 400000 2021-11-22 00:34:06,164 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call 2021-11-22 00:34:06,282 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637570046.12 2021-11-22 00:34:06,282 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637570046.12' started 2021-11-22 00:34:06,282 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:34:06,283 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:34:06,285 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637570045.99 2021-11-22 00:34:06,338 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843732 type=client open_count=1 channel=[id: 0x5700d0df, 0.0.0.0/0.0.0.0:36816] timeout=300.0>) 2021-11-22 00:35:31,842 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:35:31,851 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:35:31,851 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.nio.channels.ClosedChannelException during send (<_realsocket at 0x1843733 type=client open_count=1 channel=[id: 0x20da8fd8, 0.0.0.0/0.0.0.0:35516] timeout=300.0>) 2021-11-22 00:37:33,581 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 104] Socket closed 2021-11-22 00:37:33,588 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:37:33,588 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843734 type=client open_count=1 channel=[id: 0x8a4b2a97, 0.0.0.0/0.0.0.0:56219] timeout=300.0>) 2021-11-22 00:38:03,502 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:38:03,509 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:38:03,509 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843735 type=client open_count=1 channel=[id: 0x3865bf46, 0.0.0.0/0.0.0.0:54863] timeout=300.0>) 2021-11-22 00:40:26,072 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:40:26,073 | infra | INFO | pool-3-thread-14 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 00:40:26,075 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637570045.99' completed 2021-11-22 00:40:26,075 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637570046.05 2021-11-22 00:40:34,858 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 00:40:34,858 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 00:40:34,859 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637570046.05' completed 2021-11-22 00:40:34,859 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637570046.12 2021-11-22 00:42:36,595 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 00:42:36,595 | infra | INFO | pool-3-thread-27 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 00:42:36,595 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637570046.12' completed 2021-11-22 00:42:36,596 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 00:42:36,596 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000 2021-11-22 00:42:36,598 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 450000 2021-11-22 00:42:36,651 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637570556.6 2021-11-22 00:42:36,651 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637570556.6' started 2021-11-22 00:42:36,651 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:42:36,651 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000 2021-11-22 00:42:36,653 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 500000 2021-11-22 00:42:36,696 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call 2021-11-22 00:42:36,730 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637570556.65 2021-11-22 00:42:36,730 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637570556.65' started 2021-11-22 00:42:36,732 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:42:36,732 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000 2021-11-22 00:42:36,733 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 550000 2021-11-22 00:42:36,772 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call 2021-11-22 00:42:36,809 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637570556.73 2021-11-22 00:42:36,809 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637570556.73' started 2021-11-22 00:42:36,809 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:42:36,809 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:42:36,811 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637570556.6 2021-11-22 00:42:36,851 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843736 type=client open_count=1 channel=[id: 0x4b7a38d8, 0.0.0.0/0.0.0.0:48660] timeout=300.0>) 2021-11-22 00:43:07,694 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:43:07,701 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:43:07,701 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843737 type=client open_count=1 channel=[id: 0xecc643ab, 0.0.0.0/0.0.0.0:59897] timeout=300.0>) 2021-11-22 00:44:25,165 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:44:25,173 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:44:25,174 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843738 type=client open_count=1 channel=[id: 0xcfa949d9, 0.0.0.0/0.0.0.0:47995] timeout=300.0>) 2021-11-22 00:45:35,970 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:45:35,979 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:45:35,980 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843739 type=client open_count=1 channel=[id: 0x3f1d2ef5, 0.0.0.0/0.0.0.0:38476] timeout=300.0>) 2021-11-22 00:46:50,532 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:46:50,539 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:46:50,539 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 00:48:10,707 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 00:48:10,709 | infra | INFO | pool-3-thread-2 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 00:48:10,709 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637570556.73' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184373a type=client open_count=1 channel=[id: 0xf90bd9f8, 0.0.0.0/0.0.0.0:57382] timeout=300.0>) 2021-11-22 00:49:55,109 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:49:55,111 | infra | INFO | pool-3-thread-9 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 00:49:55,111 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637570556.6' completed 2021-11-22 00:49:55,111 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637570556.65 2021-11-22 00:50:38,984 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 00:50:38,986 | infra | INFO | pool-3-thread-12 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 00:50:38,986 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637570556.65' completed 2021-11-22 00:50:38,987 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637570556.73 2021-11-22 00:50:38,987 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 00:50:38,989 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000 2021-11-22 00:50:38,989 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 600000 2021-11-22 00:50:39,035 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637571038.99 2021-11-22 00:50:39,035 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637571038.99' started 2021-11-22 00:50:39,036 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:50:39,036 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000 2021-11-22 00:50:39,036 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 650000 2021-11-22 00:50:39,082 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call 2021-11-22 00:50:39,088 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637571039.04 2021-11-22 00:50:39,088 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637571039.04' started 2021-11-22 00:50:39,089 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:50:39,091 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000 2021-11-22 00:50:39,092 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 700000 2021-11-22 00:50:39,144 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call 2021-11-22 00:50:39,164 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637571039.09 2021-11-22 00:50:39,164 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637571039.09' started 2021-11-22 00:50:39,165 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:50:39,165 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:50:39,167 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637571038.99 2021-11-22 00:50:39,257 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184373b type=client open_count=1 channel=[id: 0xc92da612, 0.0.0.0/0.0.0.0:50635] timeout=300.0>) 2021-11-22 00:51:01,394 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:51:01,403 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:51:01,404 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184373c type=client open_count=1 channel=[id: 0x1c5fb378, 0.0.0.0/0.0.0.0:54353] timeout=300.0>) 2021-11-22 00:52:32,950 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:52:32,957 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:52:32,959 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 00:55:39,150 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 00:55:39,153 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 00:55:39,154 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637571039.04' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184373d type=client open_count=1 channel=[id: 0x41e4bc78, 0.0.0.0/0.0.0.0:36210] timeout=300.0>) 2021-11-22 00:55:55,936 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:55:55,937 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 00:55:55,938 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637571038.99' completed 2021-11-22 00:55:55,940 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637571039.04 2021-11-22 00:55:55,940 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637571039.09 2021-11-22 00:56:04,408 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 00:56:04,410 | infra | INFO | pool-3-thread-17 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 00:56:04,411 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637571039.09' completed 2021-11-22 00:56:04,411 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 00:56:04,411 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000 2021-11-22 00:56:04,413 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 750000 2021-11-22 00:56:04,451 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637571364.41 2021-11-22 00:56:04,451 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637571364.41' started 2021-11-22 00:56:04,451 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:56:04,453 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000 2021-11-22 00:56:04,453 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 800000 2021-11-22 00:56:04,493 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call 2021-11-22 00:56:04,526 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637571364.45 2021-11-22 00:56:04,526 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637571364.45' started 2021-11-22 00:56:04,526 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:56:04,528 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000 2021-11-22 00:56:04,529 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 850000 2021-11-22 00:56:04,566 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call 2021-11-22 00:56:04,601 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637571364.53 2021-11-22 00:56:04,601 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637571364.53' started 2021-11-22 00:56:04,602 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 00:56:04,604 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 00:56:04,605 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637571364.41 2021-11-22 00:56:04,648 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call 2021-11-22 00:57:50,109 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:'' with index name None 2021-11-22 00:57:50,109 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637571364.53' completed 2021-11-22 00:58:10,611 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60FunctionCollection1%60+data+USE+INDEX+%28default__default_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+800000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "2776d8e4-84d8-4554-a83c-7b896e228cf7", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m5.64189962s","executionTime": "2m5.569028323s","resultCount": 0,"resultSize": 0,"serviceLoad": 4,"sortCount": 21896,"errorCount": 1} } auth: Administrator:password 2021-11-22 00:58:10,614 | infra | DEBUG | pool-3-thread-3 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 00:58:10,615 | infra | DEBUG | pool-3-thread-3 | [task:call:6532] Status of the query 0 2021-11-22 00:58:10,615 | infra | INFO | pool-3-thread-3 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 00:58:10,615 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637571364.45' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184373e type=client open_count=1 channel=[id: 0x60ecf428, 0.0.0.0/0.0.0.0:48412] timeout=300.0>) 2021-11-22 00:58:28,648 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:58:28,654 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:58:28,655 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184373f type=client open_count=1 channel=[id: 0x6bae1be6, 0.0.0.0/0.0.0.0:42305] timeout=300.0>) 2021-11-22 00:59:15,023 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 00:59:15,032 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 00:59:15,032 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843740 type=client open_count=1 channel=[id: 0x6319de3a, 0.0.0.0/0.0.0.0:34065] timeout=300.0>) 2021-11-22 01:00:13,290 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:00:13,299 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:00:13,299 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843741 type=client open_count=1 channel=[id: 0xca737b9b, 0.0.0.0/0.0.0.0:44871] timeout=300.0>) 2021-11-22 01:01:38,561 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:01:38,562 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:01:38,562 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637571364.41' completed 2021-11-22 01:01:38,562 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637571364.45 2021-11-22 01:01:38,563 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637571364.53 2021-11-22 01:01:38,563 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:01:38,565 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000 2021-11-22 01:01:38,565 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 900000 2021-11-22 01:01:38,615 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637571698.57 2021-11-22 01:01:38,615 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637571698.57' started 2021-11-22 01:01:38,615 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:01:38,617 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000 2021-11-22 01:01:38,617 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 950000 2021-11-22 01:01:38,657 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637571698.62' started 2021-11-22 01:01:38,657 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637571698.62 2021-11-22 01:01:38,658 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:01:38,658 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call 2021-11-22 01:01:38,658 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000 2021-11-22 01:01:38,660 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1000000 Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843742 type=client open_count=1 channel=[id: 0x28c11400, 0.0.0.0/0.0.0.0:38500] timeout=300.0>) 2021-11-22 01:01:38,664 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:01:38,673 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:01:38,674 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:01:38,703 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637571698.66 2021-11-22 01:01:38,703 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637571698.66' started 2021-11-22 01:01:38,703 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:01:38,704 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:01:38,704 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637571698.57 2021-11-22 01:01:38,719 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 01:01:38,749 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843743 type=client open_count=1 channel=[id: 0xd2764f91, 0.0.0.0/0.0.0.0:51709] timeout=300.0>) 2021-11-22 01:03:43,032 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:03:43,039 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:03:43,039 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:06:38,724 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:06:38,726 | infra | INFO | pool-3-thread-10 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:06:38,726 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637571698.62' completed 2021-11-22 01:06:38,753 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:06:38,755 | infra | INFO | pool-3-thread-18 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:06:38,755 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637571698.66' completed 2021-11-22 01:08:46,046 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 01:08:46,046 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:08:46,046 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637571698.57' completed 2021-11-22 01:08:46,048 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637571698.62 2021-11-22 01:08:46,049 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637571698.66 2021-11-22 01:08:46,049 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:08:46,049 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000 2021-11-22 01:08:46,049 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1050000 2021-11-22 01:08:46,091 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637572126.05 2021-11-22 01:08:46,091 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637572126.05' started 2021-11-22 01:08:46,091 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:08:46,092 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000 2021-11-22 01:08:46,092 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1100000 2021-11-22 01:08:46,128 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call 2021-11-22 01:08:46,134 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637572126.09 2021-11-22 01:08:46,134 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637572126.09' started 2021-11-22 01:08:46,134 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:08:46,134 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000 2021-11-22 01:08:46,135 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1150000 2021-11-22 01:08:46,174 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call 2021-11-22 01:08:46,211 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637572126.14 2021-11-22 01:08:46,211 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637572126.14' started 2021-11-22 01:08:46,213 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:08:46,213 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:08:46,213 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637572126.05 2021-11-22 01:08:46,273 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843744 type=client open_count=1 channel=[id: 0x9db5a84b, 0.0.0.0/0.0.0.0:41324] timeout=300.0>) 2021-11-22 01:09:15,098 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:09:15,107 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:09:15,107 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843745 type=client open_count=1 channel=[id: 0x6d29c96c, 0.0.0.0/0.0.0.0:50372] timeout=300.0>) 2021-11-22 01:10:29,322 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:10:29,329 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:10:29,329 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843746 type=client open_count=1 channel=[id: 0xb81f6b4e, 0.0.0.0/0.0.0.0:52635] timeout=300.0>) 2021-11-22 01:10:58,686 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:10:58,694 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:10:58,694 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843747 type=client open_count=1 channel=[id: 0x080ead3c, 0.0.0.0/0.0.0.0:53519] timeout=300.0>) 2021-11-22 01:11:50,108 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:11:50,117 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:11:50,118 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843748 type=client open_count=1 channel=[id: 0xf651cc0c, 0.0.0.0/0.0.0.0:52758] timeout=300.0>) 2021-11-22 01:14:18,197 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:14:18,197 | infra | INFO | pool-3-thread-15 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:14:18,198 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637572126.05' completed 2021-11-22 01:14:18,198 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637572126.09 2021-11-22 01:15:32,336 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:15:32,338 | infra | INFO | pool-3-thread-4 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:15:32,338 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637572126.14' completed 2021-11-22 01:16:01,700 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:16:01,700 | infra | INFO | pool-3-thread-16 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:16:01,703 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637572126.09' completed 2021-11-22 01:16:01,703 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637572126.14 2021-11-22 01:16:01,704 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:16:01,706 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000 2021-11-22 01:16:01,706 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1200000 2021-11-22 01:16:01,746 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637572561.71 2021-11-22 01:16:01,746 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637572561.71' started 2021-11-22 01:16:01,747 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:16:01,747 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000 2021-11-22 01:16:01,749 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1250000 2021-11-22 01:16:01,786 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call 2021-11-22 01:16:01,809 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637572561.75 2021-11-22 01:16:01,809 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637572561.75' started 2021-11-22 01:16:01,809 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:16:01,811 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000 2021-11-22 01:16:01,811 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1300000 2021-11-22 01:16:01,848 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call 2021-11-22 01:16:01,887 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637572561.81 2021-11-22 01:16:01,888 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637572561.81' started 2021-11-22 01:16:01,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:16:01,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:16:01,888 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637572561.71 2021-11-22 01:16:01,950 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843749 type=client open_count=1 channel=[id: 0x1fa04df3, 0.0.0.0/0.0.0.0:44914] timeout=300.0>) 2021-11-22 01:17:00,805 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:17:00,812 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:17:00,812 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184374a type=client open_count=1 channel=[id: 0xb3d561ad, 0.0.0.0/0.0.0.0:33309] timeout=300.0>) 2021-11-22 01:18:07,845 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:18:07,852 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:18:07,854 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:21:01,854 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:21:01,855 | infra | INFO | pool-3-thread-29 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:21:01,855 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637572561.75' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184374b type=client open_count=1 channel=[id: 0xaf83994c, 0.0.0.0/0.0.0.0:36717] timeout=300.0>) 2021-11-22 01:21:25,872 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:21:25,872 | infra | INFO | pool-3-thread-7 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:21:25,874 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637572561.71' completed 2021-11-22 01:21:25,875 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637572561.75 2021-11-22 01:21:25,875 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637572561.81 2021-11-22 01:22:03,819 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:22:03,819 | infra | INFO | pool-3-thread-21 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:22:03,819 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637572561.81' completed 2021-11-22 01:22:03,821 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:22:03,821 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000 2021-11-22 01:22:03,822 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1350000 2021-11-22 01:22:03,864 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637572923.82 2021-11-22 01:22:03,864 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637572923.82' started 2021-11-22 01:22:03,865 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:22:03,865 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000 2021-11-22 01:22:03,865 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1400000 2021-11-22 01:22:03,904 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call 2021-11-22 01:22:03,943 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637572923.87 2021-11-22 01:22:03,944 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637572923.87' started 2021-11-22 01:22:03,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:22:03,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000 2021-11-22 01:22:03,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1450000 2021-11-22 01:22:03,993 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 01:22:04,078 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637572923.95 2021-11-22 01:22:04,078 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637572923.95' started 2021-11-22 01:22:04,078 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:22:04,078 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:22:04,079 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637572923.82 2021-11-22 01:22:04,115 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184374c type=client open_count=1 channel=[id: 0xc637ef33, 0.0.0.0/0.0.0.0:58559] timeout=300.0>) 2021-11-22 01:22:33,667 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:22:33,676 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:22:33,677 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184374d type=client open_count=1 channel=[id: 0x4bcf26f9, 0.0.0.0/0.0.0.0:39685] timeout=300.0>) 2021-11-22 01:23:39,196 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:23:39,203 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:23:39,203 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184374e type=client open_count=1 channel=[id: 0x8b2fc8ba, 0.0.0.0/0.0.0.0:46561] timeout=300.0>) 2021-11-22 01:24:23,986 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:24:23,993 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:24:23,994 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184374f type=client open_count=1 channel=[id: 0x784c28ef, 0.0.0.0/0.0.0.0:43229] timeout=300.0>) 2021-11-22 01:26:50,579 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:26:50,586 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:26:50,588 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:27:36,681 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:27:36,683 | infra | INFO | pool-3-thread-19 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:27:36,684 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637572923.87' completed 2021-11-22 01:28:42,209 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:28:42,210 | infra | INFO | pool-3-thread-6 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:28:42,210 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637572923.95' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843750 type=client open_count=1 channel=[id: 0x83595d70, 0.0.0.0/0.0.0.0:56379] timeout=300.0>) 2021-11-22 01:30:38,914 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:30:38,915 | infra | INFO | pool-3-thread-20 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:30:38,917 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637572923.82' completed 2021-11-22 01:30:38,917 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637572923.87 2021-11-22 01:30:38,917 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637572923.95 2021-11-22 01:30:38,918 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:30:38,918 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000 2021-11-22 01:30:38,920 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1500000 2021-11-22 01:30:38,970 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637573438.92 2021-11-22 01:30:38,970 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637573438.92' started 2021-11-22 01:30:38,970 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:30:38,971 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000 2021-11-22 01:30:38,971 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1550000 2021-11-22 01:30:39,009 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843751 type=client open_count=1 channel=[id: 0x27dec6f2, 0.0.0.0/0.0.0.0:50261] timeout=300.0>) 2021-11-22 01:30:39,013 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:30:39,022 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:30:39,023 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:30:39,032 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637573438.97 2021-11-22 01:30:39,032 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637573438.97' started 2021-11-22 01:30:39,032 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:30:39,032 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000 2021-11-22 01:30:39,032 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1600000 2021-11-22 01:30:39,071 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 01:30:39,305 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637573439.03 2021-11-22 01:30:39,305 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637573439.03' started 2021-11-22 01:30:39,305 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:30:39,306 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:30:39,306 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637573438.92 2021-11-22 01:30:39,369 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843752 type=client open_count=1 channel=[id: 0x79d08667, 0.0.0.0/0.0.0.0:51818] timeout=300.0>) 2021-11-22 01:31:51,045 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:31:51,052 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:31:51,052 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843753 type=client open_count=1 channel=[id: 0xede71aac, 0.0.0.0/0.0.0.0:36480] timeout=300.0>) 2021-11-22 01:32:50,549 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:32:50,558 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:32:50,559 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843754 type=client open_count=1 channel=[id: 0x9abb20e0, 0.0.0.0/0.0.0.0:44798] timeout=300.0>) 2021-11-22 01:32:53,563 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:32:53,572 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:32:53,572 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843755 type=client open_count=1 channel=[id: 0xb08d5da3, 0.0.0.0/0.0.0.0:44455] timeout=300.0>) 2021-11-22 01:32:56,576 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:32:56,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:32:56,585 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843756 type=client open_count=1 channel=[id: 0xaa7ad64d, 0.0.0.0/0.0.0.0:53297] timeout=300.0>) 2021-11-22 01:33:13,703 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:33:13,711 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:33:13,713 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:33:58,321 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60FunctionCollection1%60+data+USE+INDEX+%28default__default_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1600000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "289ebde3-9591-46ac-aaf6-9b51deab464a", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m4.233527109s","executionTime": "2m4.233205098s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 405042,"errorCount": 1} } auth: Administrator:password 2021-11-22 01:33:58,322 | infra | DEBUG | pool-3-thread-30 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 01:33:58,322 | infra | DEBUG | pool-3-thread-30 | [task:call:6532] Status of the query 0 2021-11-22 01:33:58,323 | infra | INFO | pool-3-thread-30 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 01:33:58,323 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637573439.03' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843757 type=client open_count=1 channel=[id: 0xbe0b0ea5, 0.0.0.0/0.0.0.0:40909] timeout=300.0>) 2021-11-22 01:35:32,559 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:35:32,566 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:35:32,568 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843758 type=client open_count=1 channel=[id: 0x3d169ce2, 0.0.0.0/0.0.0.0:47897] timeout=300.0>) 2021-11-22 01:36:27,453 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:36:27,454 | infra | INFO | pool-3-thread-1 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:36:27,456 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637573438.92' completed 2021-11-22 01:36:27,456 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637573438.97 Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843759 type=client open_count=1 channel=[id: 0xcfbb90b6, 0.0.0.0/0.0.0.0:37984] timeout=300.0>) 2021-11-22 01:37:56,280 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:37:56,282 | infra | INFO | pool-3-thread-24 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:37:56,282 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637573438.97' completed 2021-11-22 01:37:56,282 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637573439.03 2021-11-22 01:37:56,282 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:37:56,283 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000 2021-11-22 01:37:56,283 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1650000 2021-11-22 01:37:56,328 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637573876.29 2021-11-22 01:37:56,328 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637573876.29' started 2021-11-22 01:37:56,328 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:37:56,328 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000 2021-11-22 01:37:56,329 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1700000 2021-11-22 01:37:56,365 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call 2021-11-22 01:37:56,403 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637573876.33' started 2021-11-22 01:37:56,403 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637573876.33 2021-11-22 01:37:56,404 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:37:56,404 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000 2021-11-22 01:37:56,404 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1750000 2021-11-22 01:37:56,457 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 01:37:56,457 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637573876.41 2021-11-22 01:37:56,459 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637573876.41' started 2021-11-22 01:37:56,459 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:37:56,460 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:37:56,460 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637573876.29 Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184375a type=client open_count=1 channel=[id: 0xabebe23d, 0.0.0.0/0.0.0.0:35669] timeout=300.0>) 2021-11-22 01:37:56,463 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:37:56,470 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:37:56,470 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:37:56,500 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184375b type=client open_count=1 channel=[id: 0xbbbec30f, 0.0.0.0/0.0.0.0:35238] timeout=300.0>) 2021-11-22 01:39:29,799 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:39:29,808 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:39:29,809 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:42:56,506 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:42:56,507 | infra | INFO | pool-3-thread-23 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:42:56,507 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637573876.41' completed 2021-11-22 01:42:59,477 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:42:59,479 | infra | INFO | pool-3-thread-28 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:42:59,480 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637573876.33' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184375c type=client open_count=1 channel=[id: 0xb0c33d45, 0.0.0.0/0.0.0.0:41909] timeout=300.0>) 2021-11-22 01:44:21,459 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:44:21,460 | infra | INFO | pool-3-thread-25 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:44:21,460 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637573876.29' completed 2021-11-22 01:44:21,461 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637573876.33 2021-11-22 01:44:21,463 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637573876.41 2021-11-22 01:44:21,463 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:44:21,463 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000 2021-11-22 01:44:21,464 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1800000 2021-11-22 01:44:21,505 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637574261.46 2021-11-22 01:44:21,505 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637574261.46' started 2021-11-22 01:44:21,505 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:44:21,506 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000 2021-11-22 01:44:21,506 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1850000 2021-11-22 01:44:21,542 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184375d type=client open_count=1 channel=[id: 0xfb216163, 0.0.0.0/0.0.0.0:33063] timeout=300.0>) 2021-11-22 01:44:21,548 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:44:21,552 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637574261.51 2021-11-22 01:44:21,552 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637574261.51' started 2021-11-22 01:44:21,552 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:44:21,552 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000 2021-11-22 01:44:21,553 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1900000 2021-11-22 01:44:21,555 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:44:21,556 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:44:21,585 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call 2021-11-22 01:44:22,174 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637574261.55 2021-11-22 01:44:22,174 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637574261.55' started 2021-11-22 01:44:22,176 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:44:22,177 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:44:22,177 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637574261.46 2021-11-22 01:44:23,032 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184375e type=client open_count=1 channel=[id: 0x77f5ec93, 0.0.0.0/0.0.0.0:50489] timeout=300.0>) 2021-11-22 01:45:57,107 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:45:57,115 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:45:57,117 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:46:25,878 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60FunctionCollection1%60+data+USE+INDEX+%28default__default_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1800000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "2c458092-5f80-4090-b60e-2d3db56d8496", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m1.305939621s","executionTime": "2m1.305643314s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 150994,"errorCount": 1} } auth: Administrator:password 2021-11-22 01:46:25,881 | infra | DEBUG | pool-3-thread-14 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 01:46:25,881 | infra | DEBUG | pool-3-thread-14 | [task:call:6532] Status of the query 0 2021-11-22 01:46:25,881 | infra | INFO | pool-3-thread-14 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 01:46:25,882 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637574261.46' completed 2021-11-22 01:46:25,884 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637574261.51 2021-11-22 01:49:21,591 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 01:49:21,592 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:49:21,592 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637574261.51' completed 2021-11-22 01:49:21,594 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637574261.55 2021-11-22 01:51:00,121 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 01:51:00,122 | infra | INFO | pool-3-thread-27 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 01:51:00,124 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637574261.55' completed 2021-11-22 01:51:00,124 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:51:00,125 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000 2021-11-22 01:51:00,125 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1950000 2021-11-22 01:51:00,163 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637574660.13 2021-11-22 01:51:00,163 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637574660.13' started 2021-11-22 01:51:00,164 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:51:00,164 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000 2021-11-22 01:51:00,164 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2000000 2021-11-22 01:51:00,198 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call 2021-11-22 01:51:00,214 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637574660.16 2021-11-22 01:51:00,214 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637574660.16' started 2021-11-22 01:51:00,216 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:51:00,217 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000 2021-11-22 01:51:00,217 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2050000 2021-11-22 01:51:00,253 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call 2021-11-22 01:51:00,532 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637574660.22 2021-11-22 01:51:00,532 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637574660.22' started 2021-11-22 01:51:00,532 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:51:00,533 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:51:00,533 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637574660.13 2021-11-22 01:51:00,582 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call 2021-11-22 01:51:42,796 | infra | INFO | pool-3-thread-12 | [task:call:6536] Got exception:'' with index name None 2021-11-22 01:51:42,796 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637574660.22' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184375f type=client open_count=1 channel=[id: 0x7068a86f, 0.0.0.0/0.0.0.0:34276] timeout=300.0>) 2021-11-22 01:52:43,394 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:52:43,401 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:52:43,401 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843760 type=client open_count=1 channel=[id: 0x287a9554, 0.0.0.0/0.0.0.0:40837] timeout=300.0>) 2021-11-22 01:53:26,321 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:53:26,328 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:53:26,328 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843761 type=client open_count=1 channel=[id: 0xa7df95c7, 0.0.0.0/0.0.0.0:34937] timeout=300.0>) 2021-11-22 01:54:13,861 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:54:13,868 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:54:13,868 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843762 type=client open_count=1 channel=[id: 0x81315c96, 0.0.0.0/0.0.0.0:39216] timeout=300.0>) 2021-11-22 01:54:53,355 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:54:53,364 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:54:53,365 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843763 type=client open_count=1 channel=[id: 0xb713c5ed, 0.0.0.0/0.0.0.0:47324] timeout=300.0>) 2021-11-22 01:55:29,522 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:55:29,529 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:55:29,529 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843764 type=client open_count=1 channel=[id: 0xf617fa2a, 0.0.0.0/0.0.0.0:52666] timeout=300.0>) 2021-11-22 01:55:37,473 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:55:37,482 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:55:37,483 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843765 type=client open_count=1 channel=[id: 0x500294d7, 0.0.0.0/0.0.0.0:54303] timeout=300.0>) 2021-11-22 01:56:13,447 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:56:13,450 | infra | INFO | pool-3-thread-2 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 01:56:13,450 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637574660.13' completed 2021-11-22 01:56:13,450 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637574660.16 Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843766 type=client open_count=1 channel=[id: 0xfcaa8094, 0.0.0.0/0.0.0.0:54802] timeout=300.0>) 2021-11-22 01:58:17,822 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:58:17,823 | infra | INFO | pool-3-thread-9 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 01:58:17,825 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637574660.16' completed 2021-11-22 01:58:17,825 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637574660.22 2021-11-22 01:58:17,825 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 01:58:17,826 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000 2021-11-22 01:58:17,826 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2100000 2021-11-22 01:58:17,861 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637575097.83 2021-11-22 01:58:17,861 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637575097.83' started 2021-11-22 01:58:17,862 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:58:17,862 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0 2021-11-22 01:58:17,864 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 0 2021-11-22 01:58:17,898 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call 2021-11-22 01:58:17,908 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637575097.86 2021-11-22 01:58:17,908 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637575097.86' started 2021-11-22 01:58:17,908 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:58:17,910 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000 2021-11-22 01:58:17,910 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 50000 2021-11-22 01:58:17,946 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637575097.91 2021-11-22 01:58:17,946 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637575097.91' started 2021-11-22 01:58:17,946 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 01:58:17,947 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 01:58:17,947 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637575097.83 2021-11-22 01:58:17,966 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843767 type=client open_count=1 channel=[id: 0x02451710, 0.0.0.0/0.0.0.0:34995] timeout=300.0>) 2021-11-22 01:58:17,970 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:58:17,980 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:58:17,980 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 01:58:17,983 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843768 type=client open_count=1 channel=[id: 0x60f93a13, 0.0.0.0/0.0.0.0:56805] timeout=300.0>) 2021-11-22 01:58:49,528 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 01:58:49,535 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 01:58:49,535 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843769 type=client open_count=1 channel=[id: 0x59597d66, 0.0.0.0/0.0.0.0:55532] timeout=300.0>) 2021-11-22 02:03:08,213 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:03:08,221 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:03:08,221 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:03:17,986 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:03:17,987 | infra | INFO | pool-3-thread-17 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:03:17,989 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637575097.91' completed 2021-11-22 02:03:20,986 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:03:20,986 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:03:20,986 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637575097.86' completed 2021-11-22 02:08:11,226 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 02:08:11,227 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:08:11,229 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`FunctionCollection1` data USE INDEX (default__default_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637575097.83' completed 2021-11-22 02:08:11,229 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637575097.86 2021-11-22 02:08:11,230 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637575097.91 2021-11-22 02:08:11,230 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:08:11,230 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000 2021-11-22 02:08:11,232 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 100000 2021-11-22 02:08:11,273 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637575691.23 2021-11-22 02:08:11,273 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637575691.23' started 2021-11-22 02:08:11,273 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:08:11,275 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000 2021-11-22 02:08:11,275 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 150000 2021-11-22 02:08:11,308 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call 2021-11-22 02:08:11,319 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637575691.28' started 2021-11-22 02:08:11,319 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637575691.28 2021-11-22 02:08:11,319 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:08:11,319 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000 2021-11-22 02:08:11,321 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 200000 2021-11-22 02:08:11,354 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call 2021-11-22 02:08:11,384 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637575691.32 2021-11-22 02:08:11,384 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637575691.32' started 2021-11-22 02:08:11,384 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:08:11,385 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:08:11,385 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637575691.23 2021-11-22 02:08:11,424 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184376a type=client open_count=1 channel=[id: 0xbf5b3739, 0.0.0.0/0.0.0.0:36507] timeout=300.0>) 2021-11-22 02:08:20,414 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:08:20,421 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:08:20,421 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184376b type=client open_count=1 channel=[id: 0x5a206a76, 0.0.0.0/0.0.0.0:49829] timeout=300.0>) 2021-11-22 02:08:23,740 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:08:23,750 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:08:23,750 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184376c type=client open_count=1 channel=[id: 0x2a7dff13, 0.0.0.0/0.0.0.0:57835] timeout=300.0>) 2021-11-22 02:09:52,493 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:09:52,500 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:09:52,502 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:13:11,358 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:13:11,359 | infra | INFO | pool-3-thread-3 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:13:11,359 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637575691.28' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184376d type=client open_count=1 channel=[id: 0xfa2773bf, 0.0.0.0/0.0.0.0:34914] timeout=300.0>) 2021-11-22 02:13:15,132 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:13:15,132 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:13:15,134 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637575691.23' completed 2021-11-22 02:13:15,134 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637575691.28 2021-11-22 02:13:15,134 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637575691.32 2021-11-22 02:13:26,756 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:13:26,757 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:13:26,757 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637575691.32' completed 2021-11-22 02:13:26,759 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:13:26,759 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000 2021-11-22 02:13:26,760 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 250000 2021-11-22 02:13:26,799 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637576006.76 2021-11-22 02:13:26,799 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637576006.76' started 2021-11-22 02:13:26,799 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:13:26,799 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000 2021-11-22 02:13:26,799 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 300000 2021-11-22 02:13:26,835 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 02:13:26,884 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637576006.8 2021-11-22 02:13:26,884 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637576006.8' started 2021-11-22 02:13:26,884 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:13:26,885 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000 2021-11-22 02:13:26,885 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 350000 2021-11-22 02:13:26,923 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call 2021-11-22 02:13:26,970 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637576006.89' started 2021-11-22 02:13:26,970 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637576006.89 2021-11-22 02:13:26,970 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:13:26,971 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:13:26,971 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637576006.76 2021-11-22 02:13:27,009 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184376e type=client open_count=1 channel=[id: 0x427df70e, 0.0.0.0/0.0.0.0:51170] timeout=300.0>) 2021-11-22 02:14:52,823 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:14:52,832 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:14:52,832 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:15:30,983 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+300000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "ef814075-cceb-40bd-9a2f-09159d8a8456", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m2.260715095s","executionTime": "2m2.255742996s","resultCount": 0,"resultSize": 0,"serviceLoad": 4,"sortCount": 67048,"errorCount": 1} } auth: Administrator:password 2021-11-22 02:15:30,986 | infra | DEBUG | pool-3-thread-18 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 02:15:30,986 | infra | DEBUG | pool-3-thread-18 | [task:call:6532] Status of the query 0 2021-11-22 02:15:30,987 | infra | INFO | pool-3-thread-18 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 02:15:30,987 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637576006.8' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184376f type=client open_count=1 channel=[id: 0x831996e9, 0.0.0.0/0.0.0.0:37052] timeout=300.0>) 2021-11-22 02:15:49,645 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:15:49,654 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:15:49,654 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:18:01,930 | infra | DEBUG | pool-3-thread-10 | [task:call:6532] Status of the query 1 2021-11-22 02:18:01,930 | infra | INFO | pool-3-thread-10 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 02:18:01,930 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637576006.76' completed 2021-11-22 02:18:01,931 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637576006.8 2021-11-22 02:18:01,933 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637576006.89 2021-11-22 02:19:55,838 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:19:55,838 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:19:55,838 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637576006.89' completed 2021-11-22 02:19:55,839 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:19:55,841 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000 2021-11-22 02:19:55,841 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 400000 2021-11-22 02:19:55,885 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637576395.84 2021-11-22 02:19:55,887 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637576395.84' started 2021-11-22 02:19:55,887 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:19:55,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000 2021-11-22 02:19:55,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 450000 2021-11-22 02:19:55,950 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call 2021-11-22 02:19:56,203 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637576395.89 2021-11-22 02:19:56,203 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637576395.89' started 2021-11-22 02:19:56,203 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:19:56,203 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000 2021-11-22 02:19:56,203 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 500000 2021-11-22 02:19:56,255 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call 2021-11-22 02:19:56,555 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637576396.2 2021-11-22 02:19:56,555 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637576396.2' started 2021-11-22 02:19:56,555 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:19:56,555 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:19:56,555 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637576395.84 2021-11-22 02:19:56,595 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call 2021-11-22 02:20:21,062 | infra | INFO | pool-3-thread-16 | [task:call:6536] Got exception:'' with index name None 2021-11-22 02:20:21,062 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637576396.2' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843770 type=client open_count=1 channel=[id: 0xf2651d6c, 0.0.0.0/0.0.0.0:56014] timeout=300.0>) 2021-11-22 02:21:25,157 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:21:25,165 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:21:25,165 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843771 type=client open_count=1 channel=[id: 0xbbbb2d72, 0.0.0.0/0.0.0.0:40209] timeout=300.0>) 2021-11-22 02:22:01,960 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:22:01,969 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:22:01,970 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843772 type=client open_count=1 channel=[id: 0x0a971daf, 0.0.0.0/0.0.0.0:43071] timeout=300.0>) 2021-11-22 02:22:13,908 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:22:13,917 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:22:13,917 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843773 type=client open_count=1 channel=[id: 0x81013459, 0.0.0.0/0.0.0.0:53803] timeout=300.0>) 2021-11-22 02:23:12,653 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:23:12,660 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:23:12,661 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843774 type=client open_count=1 channel=[id: 0x249caa3f, 0.0.0.0/0.0.0.0:36305] timeout=300.0>) 2021-11-22 02:23:59,849 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:23:59,859 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:23:59,859 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843775 type=client open_count=1 channel=[id: 0xe2a37113, 0.0.0.0/0.0.0.0:46389] timeout=300.0>) 2021-11-22 02:25:06,776 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:25:06,776 | infra | INFO | pool-3-thread-15 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:25:06,776 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637576395.84' completed 2021-11-22 02:25:06,778 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637576395.89 Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843776 type=client open_count=1 channel=[id: 0xaf896a15, 0.0.0.0/0.0.0.0:55246] timeout=300.0>) 2021-11-22 02:26:33,596 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:26:33,598 | infra | INFO | pool-3-thread-4 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:26:33,598 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637576395.89' completed 2021-11-22 02:26:33,598 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637576396.2 2021-11-22 02:26:33,598 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:26:33,599 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000 2021-11-22 02:26:33,599 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 550000 2021-11-22 02:26:33,637 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637576793.6 2021-11-22 02:26:33,637 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637576793.6' started 2021-11-22 02:26:33,638 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:26:33,638 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000 2021-11-22 02:26:33,638 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 600000 2021-11-22 02:26:33,674 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call 2021-11-22 02:26:33,720 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637576793.64 2021-11-22 02:26:33,720 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637576793.64' started 2021-11-22 02:26:33,721 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:26:33,721 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000 2021-11-22 02:26:33,723 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 650000 2021-11-22 02:26:33,759 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637576793.72 2021-11-22 02:26:33,759 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637576793.72' started 2021-11-22 02:26:33,759 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:26:33,760 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:26:33,760 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637576793.6 2021-11-22 02:26:33,770 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843777 type=client open_count=1 channel=[id: 0x9d2b421a, 0.0.0.0/0.0.0.0:55092] timeout=300.0>) 2021-11-22 02:26:33,776 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:26:33,783 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:26:33,785 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:26:33,799 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843778 type=client open_count=1 channel=[id: 0x8a1f00d7, 0.0.0.0/0.0.0.0:54455] timeout=300.0>) 2021-11-22 02:27:58,595 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:27:58,602 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:27:58,604 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843779 type=client open_count=1 channel=[id: 0xbad4ca11, 0.0.0.0/0.0.0.0:45938] timeout=300.0>) 2021-11-22 02:31:12,421 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:31:12,430 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:31:12,430 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:31:33,803 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:31:33,803 | infra | INFO | pool-3-thread-21 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:31:33,805 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637576793.72' completed 2021-11-22 02:31:36,789 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:31:36,789 | infra | INFO | pool-3-thread-7 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:31:36,790 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637576793.64' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184377a type=client open_count=1 channel=[id: 0x50ab5058, 0.0.0.0/0.0.0.0:48958] timeout=300.0>) 2021-11-22 02:35:30,891 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:35:30,891 | infra | INFO | pool-3-thread-29 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:35:30,891 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637576793.6' completed 2021-11-22 02:35:30,892 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637576793.64 2021-11-22 02:35:30,892 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637576793.72 2021-11-22 02:35:30,894 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:35:30,894 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000 2021-11-22 02:35:30,894 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 700000 2021-11-22 02:35:30,934 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637577330.89 2021-11-22 02:35:30,934 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637577330.89' started 2021-11-22 02:35:30,934 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:35:30,936 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000 2021-11-22 02:35:30,936 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 750000 2021-11-22 02:35:30,971 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184377b type=client open_count=1 channel=[id: 0x40f38e53, 0.0.0.0/0.0.0.0:41922] timeout=300.0>) 2021-11-22 02:35:30,976 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:35:30,984 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:35:30,984 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:35:30,989 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637577330.94 2021-11-22 02:35:30,989 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637577330.94' started 2021-11-22 02:35:30,989 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:35:30,990 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000 2021-11-22 02:35:30,990 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 800000 2021-11-22 02:35:31,029 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637577330.99 2021-11-22 02:35:31,029 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637577330.99' started 2021-11-22 02:35:31,029 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:35:31,029 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:35:31,029 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call 2021-11-22 02:35:31,030 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637577330.89 2021-11-22 02:35:31,068 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184377c type=client open_count=1 channel=[id: 0x45a08559, 0.0.0.0/0.0.0.0:46809] timeout=300.0>) 2021-11-22 02:36:38,556 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:36:38,563 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:36:38,563 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184377d type=client open_count=1 channel=[id: 0xa26f2f73, 0.0.0.0/0.0.0.0:38886] timeout=300.0>) 2021-11-22 02:36:44,315 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:36:44,322 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:36:44,323 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:37:33,355 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+800000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "eed8dbab-9050-42ed-b88d-523b9d57fa8a", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m2.255415689s","executionTime": "2m2.254892625s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 442408,"errorCount": 1} } auth: Administrator:password 2021-11-22 02:37:33,357 | infra | DEBUG | pool-3-thread-20 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 02:37:33,358 | infra | DEBUG | pool-3-thread-20 | [task:call:6532] Status of the query 0 2021-11-22 02:37:33,358 | infra | INFO | pool-3-thread-20 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 02:37:33,358 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637577330.99' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184377e type=client open_count=1 channel=[id: 0x37e65ce1, 0.0.0.0/0.0.0.0:58841] timeout=300.0>) 2021-11-22 02:38:20,717 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:38:20,726 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:38:20,726 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184377f type=client open_count=1 channel=[id: 0x81bea47b, 0.0.0.0/0.0.0.0:38072] timeout=300.0>) 2021-11-22 02:39:38,809 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:39:38,818 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:39:38,819 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843780 type=client open_count=1 channel=[id: 0x82849216, 0.0.0.0/0.0.0.0:46509] timeout=300.0>) 2021-11-22 02:40:37,131 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:40:37,132 | infra | INFO | pool-3-thread-19 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:40:37,132 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637577330.89' completed 2021-11-22 02:40:37,134 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637577330.94 2021-11-22 02:41:47,329 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:41:47,331 | infra | INFO | pool-3-thread-6 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:41:47,331 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637577330.94' completed 2021-11-22 02:41:47,332 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637577330.99 2021-11-22 02:41:47,332 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:41:47,332 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000 2021-11-22 02:41:47,332 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 850000 2021-11-22 02:41:47,369 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637577707.33 2021-11-22 02:41:47,371 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637577707.33' started 2021-11-22 02:41:47,371 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:41:47,371 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000 2021-11-22 02:41:47,371 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 900000 2021-11-22 02:41:47,408 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call 2021-11-22 02:41:47,413 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637577707.37 2021-11-22 02:41:47,414 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637577707.37' started 2021-11-22 02:41:47,414 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:41:47,414 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000 2021-11-22 02:41:47,414 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 950000 2021-11-22 02:41:47,453 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637577707.41 2021-11-22 02:41:47,454 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637577707.41' started 2021-11-22 02:41:47,454 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:41:47,456 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:41:47,456 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637577707.33 2021-11-22 02:41:47,459 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call 2021-11-22 02:41:47,489 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843781 type=client open_count=1 channel=[id: 0xc180ae46, 0.0.0.0/0.0.0.0:42844] timeout=300.0>) 2021-11-22 02:42:38,183 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:42:38,190 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:42:38,191 | infra | DEBUG | pool-3-thread-1 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843782 type=client open_count=1 channel=[id: 0x89ecbe16, 0.0.0.0/0.0.0.0:51484] timeout=300.0>) 2021-11-22 02:43:19,948 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:43:19,957 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:43:19,957 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843783 type=client open_count=1 channel=[id: 0x511947b3, 0.0.0.0/0.0.0.0:53811] timeout=300.0>) 2021-11-22 02:45:48,921 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:45:48,928 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:45:48,928 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:46:47,493 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:46:47,494 | infra | INFO | pool-3-thread-24 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:46:47,494 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637577707.41' completed 2021-11-22 02:47:41,197 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:47:41,197 | infra | INFO | pool-3-thread-1 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:47:41,197 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637577707.37' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843784 type=client open_count=1 channel=[id: 0xb73fab1f, 0.0.0.0/0.0.0.0:54877] timeout=300.0>) 2021-11-22 02:49:12,841 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:49:12,842 | infra | INFO | pool-3-thread-30 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:49:12,842 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637577707.33' completed 2021-11-22 02:49:12,844 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637577707.37 2021-11-22 02:49:12,844 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637577707.41 2021-11-22 02:49:12,845 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:49:12,845 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000 2021-11-22 02:49:12,845 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1000000 2021-11-22 02:49:12,894 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637578152.85 2021-11-22 02:49:12,894 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637578152.85' started 2021-11-22 02:49:12,894 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:49:12,895 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000 2021-11-22 02:49:12,895 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1050000 2021-11-22 02:49:12,948 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843785 type=client open_count=1 channel=[id: 0x8c24022f, 0.0.0.0/0.0.0.0:59361] timeout=300.0>) 2021-11-22 02:49:12,956 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:49:12,964 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:49:12,964 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 02:49:12,970 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637578152.9 2021-11-22 02:49:12,970 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637578152.9' started 2021-11-22 02:49:12,971 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:49:12,973 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000 2021-11-22 02:49:12,973 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1100000 2021-11-22 02:49:13,007 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 02:49:13,101 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637578152.97 2021-11-22 02:49:13,101 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637578152.97' started 2021-11-22 02:49:13,101 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:49:13,101 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:49:13,102 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637578152.85 2021-11-22 02:49:13,142 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843786 type=client open_count=1 channel=[id: 0x8a8ed572, 0.0.0.0/0.0.0.0:35413] timeout=300.0>) 2021-11-22 02:49:50,391 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:49:50,401 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:49:50,401 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843787 type=client open_count=1 channel=[id: 0x89bf2022, 0.0.0.0/0.0.0.0:40834] timeout=300.0>) 2021-11-22 02:50:19,073 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:50:19,084 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:50:19,085 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843788 type=client open_count=1 channel=[id: 0x12ee844f, 0.0.0.0/0.0.0.0:39841] timeout=300.0>) 2021-11-22 02:51:12,032 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:51:12,039 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:51:12,040 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843789 type=client open_count=1 channel=[id: 0x6a8efb46, 0.0.0.0/0.0.0.0:42983] timeout=300.0>) 2021-11-22 02:54:14,190 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:54:14,190 | infra | INFO | pool-3-thread-23 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 02:54:14,191 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637578152.85' completed 2021-11-22 02:54:14,191 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637578152.9 2021-11-22 02:54:53,407 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 02:54:53,407 | infra | INFO | pool-3-thread-25 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 02:54:53,407 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637578152.97' completed 2021-11-22 02:55:22,095 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 02:55:22,096 | infra | INFO | pool-3-thread-28 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 02:55:22,096 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637578152.9' completed 2021-11-22 02:55:22,098 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637578152.97 2021-11-22 02:55:22,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 02:55:22,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000 2021-11-22 02:55:22,099 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1150000 2021-11-22 02:55:22,141 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637578522.1 2021-11-22 02:55:22,141 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637578522.1' started 2021-11-22 02:55:22,141 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:55:22,142 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000 2021-11-22 02:55:22,144 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1200000 2021-11-22 02:55:22,187 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call 2021-11-22 02:55:22,246 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637578522.14 2021-11-22 02:55:22,246 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637578522.14' started 2021-11-22 02:55:22,247 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:55:22,249 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000 2021-11-22 02:55:22,250 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1250000 2021-11-22 02:55:22,288 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call 2021-11-22 02:55:22,321 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637578522.25' started 2021-11-22 02:55:22,321 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637578522.25 2021-11-22 02:55:22,322 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 02:55:22,322 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 02:55:22,322 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637578522.1 2021-11-22 02:55:22,388 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184378a type=client open_count=1 channel=[id: 0x7d260982, 0.0.0.0/0.0.0.0:44216] timeout=300.0>) 2021-11-22 02:56:25,788 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:56:25,799 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:56:25,799 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184378b type=client open_count=1 channel=[id: 0xa361a297, 0.0.0.0/0.0.0.0:56048] timeout=300.0>) 2021-11-22 02:58:08,874 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:58:08,882 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:58:08,884 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184378c type=client open_count=1 channel=[id: 0x05c24506, 0.0.0.0/0.0.0.0:33674] timeout=300.0>) 2021-11-22 02:58:36,148 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 02:58:36,155 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 02:58:36,157 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184378d type=client open_count=1 channel=[id: 0x7fed1aaa, 0.0.0.0/0.0.0.0:41551] timeout=300.0>) 2021-11-22 03:01:04,444 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:01:04,446 | infra | INFO | pool-3-thread-14 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:01:04,446 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637578522.1' completed 2021-11-22 03:01:04,447 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637578522.14 2021-11-22 03:01:28,805 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:01:28,805 | infra | INFO | pool-3-thread-27 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:01:28,805 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637578522.25' completed 2021-11-22 03:03:39,161 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:03:39,163 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:03:39,164 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637578522.14' completed 2021-11-22 03:03:39,164 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637578522.25 2021-11-22 03:03:39,164 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:03:39,165 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000 2021-11-22 03:03:39,165 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1300000 2021-11-22 03:03:39,201 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637579019.17 2021-11-22 03:03:39,201 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637579019.17' started 2021-11-22 03:03:39,201 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:03:39,203 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000 2021-11-22 03:03:39,203 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1350000 2021-11-22 03:03:39,234 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call 2021-11-22 03:03:39,240 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637579019.2 2021-11-22 03:03:39,240 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637579019.2' started 2021-11-22 03:03:39,240 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:03:39,242 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000 2021-11-22 03:03:39,242 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1400000 2021-11-22 03:03:39,273 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call 2021-11-22 03:03:39,339 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637579019.24 2021-11-22 03:03:39,339 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637579019.24' started 2021-11-22 03:03:39,341 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:03:39,341 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:03:39,341 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637579019.17 2021-11-22 03:03:39,377 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call 2021-11-22 03:04:07,282 | infra | INFO | pool-3-thread-9 | [task:call:6536] Got exception:'' with index name None 2021-11-22 03:04:07,283 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637579019.24' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184378e type=client open_count=1 channel=[id: 0x85b0f755, 0.0.0.0/0.0.0.0:35303] timeout=300.0>) 2021-11-22 03:04:59,132 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:04:59,142 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:04:59,144 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184378f type=client open_count=1 channel=[id: 0x544fcec9, 0.0.0.0/0.0.0.0:47832] timeout=300.0>) 2021-11-22 03:05:02,595 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:05:02,605 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:05:02,605 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843790 type=client open_count=1 channel=[id: 0x22990894, 0.0.0.0/0.0.0.0:48358] timeout=300.0>) 2021-11-22 03:05:54,559 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:05:54,566 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:05:54,568 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843791 type=client open_count=1 channel=[id: 0xad763b59, 0.0.0.0/0.0.0.0:34176] timeout=300.0>) 2021-11-22 03:06:50,729 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:06:50,736 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:06:50,737 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843792 type=client open_count=1 channel=[id: 0xe1c0d3ed, 0.0.0.0/0.0.0.0:33070] timeout=300.0>) 2021-11-22 03:07:38,292 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:07:38,302 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:07:38,302 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843793 type=client open_count=1 channel=[id: 0xa99e87cb, 0.0.0.0/0.0.0.0:49054] timeout=300.0>) 2021-11-22 03:08:33,631 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:08:33,640 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:08:33,640 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843794 type=client open_count=1 channel=[id: 0x49fc11df, 0.0.0.0/0.0.0.0:44927] timeout=300.0>) 2021-11-22 03:09:28,214 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:09:28,216 | infra | INFO | pool-3-thread-12 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:09:28,216 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637579019.17' completed 2021-11-22 03:09:28,217 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637579019.2 2021-11-22 03:10:05,611 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:10:05,611 | infra | INFO | pool-3-thread-2 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:10:05,612 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637579019.2' completed 2021-11-22 03:10:05,612 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637579019.24 2021-11-22 03:10:05,614 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:10:05,614 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000 2021-11-22 03:10:05,615 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1450000 2021-11-22 03:10:05,657 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637579405.62' started 2021-11-22 03:10:05,657 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637579405.62 2021-11-22 03:10:05,658 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:10:05,658 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000 2021-11-22 03:10:05,660 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1500000 2021-11-22 03:10:05,691 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call 2021-11-22 03:10:05,911 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637579405.66 2021-11-22 03:10:05,911 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637579405.66' started 2021-11-22 03:10:05,911 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:10:05,913 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000 2021-11-22 03:10:05,914 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1550000 2021-11-22 03:10:05,947 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637579405.91 2021-11-22 03:10:05,947 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637579405.91' started 2021-11-22 03:10:05,947 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:10:05,948 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:10:05,948 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637579405.62 2021-11-22 03:10:05,963 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call 2021-11-22 03:10:05,990 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843795 type=client open_count=1 channel=[id: 0xadd5e719, 0.0.0.0/0.0.0.0:36956] timeout=300.0>) 2021-11-22 03:10:27,704 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:10:27,713 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:10:27,713 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843796 type=client open_count=1 channel=[id: 0x3c89e620, 0.0.0.0/0.0.0.0:43920] timeout=300.0>) 2021-11-22 03:11:42,835 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:11:42,844 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:11:42,844 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843797 type=client open_count=1 channel=[id: 0x48d3d61e, 0.0.0.0/0.0.0.0:54265] timeout=300.0>) 2021-11-22 03:14:14,845 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:14:14,854 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:14:14,855 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:15:05,996 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:15:05,996 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:15:05,997 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637579405.91' completed 2021-11-22 03:15:30,717 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:15:30,719 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:15:30,720 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637579405.66' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843798 type=client open_count=1 channel=[id: 0x3e74d18b, 0.0.0.0/0.0.0.0:54662] timeout=300.0>) 2021-11-22 03:18:40,940 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:18:40,941 | infra | INFO | pool-3-thread-17 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:18:40,941 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637579405.62' completed 2021-11-22 03:18:40,943 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637579405.66 2021-11-22 03:18:40,944 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637579405.91 2021-11-22 03:18:40,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:18:40,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000 2021-11-22 03:18:40,944 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1600000 2021-11-22 03:18:40,996 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637579920.94' started 2021-11-22 03:18:40,996 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637579920.94 2021-11-22 03:18:40,996 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:18:40,996 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000 2021-11-22 03:18:40,997 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1650000 2021-11-22 03:18:41,035 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843799 type=client open_count=1 channel=[id: 0x309e3578, 0.0.0.0/0.0.0.0:45643] timeout=300.0>) 2021-11-22 03:18:41,039 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:18:41,049 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:18:41,051 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:18:41,073 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637579921.0 2021-11-22 03:18:41,073 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637579921.0' started 2021-11-22 03:18:41,073 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:18:41,075 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000 2021-11-22 03:18:41,075 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1700000 2021-11-22 03:18:41,109 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637579921.08 2021-11-22 03:18:41,109 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637579921.08' started 2021-11-22 03:18:41,109 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:18:41,111 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:18:41,111 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call 2021-11-22 03:18:41,111 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637579920.94 2021-11-22 03:18:41,148 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x184379a type=client open_count=1 channel=[id: 0x7127aa27, 0.0.0.0/0.0.0.0:48248] timeout=300.0>) 2021-11-22 03:19:32,072 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:19:32,079 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:19:32,081 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184379b type=client open_count=1 channel=[id: 0x329d3cb5, 0.0.0.0/0.0.0.0:43558] timeout=300.0>) 2021-11-22 03:20:37,403 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:20:37,410 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:20:37,411 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184379c type=client open_count=1 channel=[id: 0xfe3465e2, 0.0.0.0/0.0.0.0:57158] timeout=300.0>) 2021-11-22 03:22:42,157 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:22:42,164 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:22:42,164 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:23:41,153 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:23:41,154 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:23:41,154 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637579921.08' completed 2021-11-22 03:24:35,085 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:24:35,088 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:24:35,088 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637579921.0' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184379d type=client open_count=1 channel=[id: 0x50179caa, 0.0.0.0/0.0.0.0:38268] timeout=300.0>) 2021-11-22 03:25:54,651 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:25:54,653 | infra | INFO | pool-3-thread-3 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:25:54,653 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637579920.94' completed 2021-11-22 03:25:54,654 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637579921.0 2021-11-22 03:25:54,654 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637579921.08 2021-11-22 03:25:54,654 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:25:54,655 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000 2021-11-22 03:25:54,655 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1750000 2021-11-22 03:25:54,691 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637580354.66' started 2021-11-22 03:25:54,691 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637580354.66 2021-11-22 03:25:54,693 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:25:54,694 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000 2021-11-22 03:25:54,694 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1800000 2021-11-22 03:25:54,726 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184379e type=client open_count=1 channel=[id: 0xaeb02d3d, 0.0.0.0/0.0.0.0:45411] timeout=300.0>) 2021-11-22 03:25:54,730 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:25:54,740 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:25:54,740 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:25:54,744 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637580354.69' started 2021-11-22 03:25:54,744 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637580354.69 2021-11-22 03:25:54,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:25:54,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000 2021-11-22 03:25:54,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1850000 2021-11-22 03:25:54,786 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 03:25:54,970 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637580354.75 2021-11-22 03:25:54,971 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637580354.75' started 2021-11-22 03:25:54,971 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:25:54,973 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:25:54,973 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637580354.66 2021-11-22 03:25:55,016 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x184379f type=client open_count=1 channel=[id: 0x48767458, 0.0.0.0/0.0.0.0:33895] timeout=300.0>) 2021-11-22 03:26:55,194 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:26:55,201 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:26:55,201 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a0 type=client open_count=1 channel=[id: 0xce9e5085, 0.0.0.0/0.0.0.0:36762] timeout=300.0>) 2021-11-22 03:27:56,385 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:27:56,392 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:27:56,394 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437a1 type=client open_count=1 channel=[id: 0x44660fa1, 0.0.0.0/0.0.0.0:53544] timeout=300.0>) 2021-11-22 03:28:01,486 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:28:01,493 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:28:01,493 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a2 type=client open_count=1 channel=[id: 0x6c968b4a, 0.0.0.0/0.0.0.0:36732] timeout=300.0>) 2021-11-22 03:30:17,200 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:30:17,209 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:30:17,210 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:31:58,207 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:31:58,207 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:31:58,209 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637580354.75' completed 2021-11-22 03:33:04,500 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:33:04,502 | infra | INFO | pool-3-thread-10 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:33:04,502 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637580354.69' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a3 type=client open_count=1 channel=[id: 0x6030be1a, 0.0.0.0/0.0.0.0:51941] timeout=300.0>) 2021-11-22 03:33:34,786 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:33:34,786 | infra | INFO | pool-3-thread-18 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:33:34,788 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637580354.66' completed 2021-11-22 03:33:34,788 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637580354.69 2021-11-22 03:33:34,789 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637580354.75 2021-11-22 03:33:34,789 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:33:34,789 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000 2021-11-22 03:33:34,789 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1900000 2021-11-22 03:33:34,825 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637580814.79 2021-11-22 03:33:34,825 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637580814.79' started 2021-11-22 03:33:34,825 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:33:34,825 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000 2021-11-22 03:33:34,826 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1950000 2021-11-22 03:33:34,858 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a4 type=client open_count=1 channel=[id: 0x83f30c0e, 0.0.0.0/0.0.0.0:58514] timeout=300.0>) 2021-11-22 03:33:34,864 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:33:34,868 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637580814.83 2021-11-22 03:33:34,868 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637580814.83' started 2021-11-22 03:33:34,868 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:33:34,869 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000 2021-11-22 03:33:34,871 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2000000 2021-11-22 03:33:34,871 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:33:34,872 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:33:34,905 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call 2021-11-22 03:33:34,966 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637580814.87 2021-11-22 03:33:34,967 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637580814.87' started 2021-11-22 03:33:34,967 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:33:34,967 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:33:34,967 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637580814.79 2021-11-22 03:33:35,043 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437a5 type=client open_count=1 channel=[id: 0xecd1bb26, 0.0.0.0/0.0.0.0:47473] timeout=300.0>) 2021-11-22 03:35:11,872 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:35:11,881 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:35:11,881 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:35:36,983 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1950000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "ac5d4718-21de-4142-856c-3eb73e130bd0", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m1.587877711s","executionTime": "2m1.578381888s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 77452,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:35:36,983 | infra | DEBUG | pool-3-thread-15 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:35:36,984 | infra | DEBUG | pool-3-thread-15 | [task:call:6532] Status of the query 0 2021-11-22 03:35:36,986 | infra | INFO | pool-3-thread-15 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:35:36,986 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637580814.83' completed 2021-11-22 03:35:40,618 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1900000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "f0b0ad8c-2702-4b9a-a605-dadabdc0154f", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m2.698310248s","executionTime": "2m2.697820221s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 326434,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:35:40,621 | infra | DEBUG | pool-3-thread-16 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:35:40,621 | infra | DEBUG | pool-3-thread-16 | [task:call:6532] Status of the query 0 2021-11-22 03:35:40,621 | infra | INFO | pool-3-thread-16 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:35:40,621 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637580814.79' completed 2021-11-22 03:35:40,622 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637580814.83 2021-11-22 03:35:40,624 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637580814.87 2021-11-22 03:40:14,885 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:40:14,887 | infra | INFO | pool-3-thread-4 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:40:14,888 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637580814.87' completed 2021-11-22 03:40:14,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:40:14,888 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000 2021-11-22 03:40:14,890 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2050000 2021-11-22 03:40:14,924 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637581214.89 2021-11-22 03:40:14,924 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637581214.89' started 2021-11-22 03:40:14,924 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:40:14,926 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000 2021-11-22 03:40:14,926 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2100000 2021-11-22 03:40:14,960 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call 2021-11-22 03:40:14,993 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637581214.93 2021-11-22 03:40:14,993 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637581214.93' started 2021-11-22 03:40:14,993 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:40:14,994 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0 2021-11-22 03:40:14,994 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 0 2021-11-22 03:40:15,029 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call 2021-11-22 03:40:15,476 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637581215.0 2021-11-22 03:40:15,476 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637581215.0' started 2021-11-22 03:40:15,476 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:40:15,476 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:40:15,476 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637581214.89 2021-11-22 03:40:15,519 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437a6 type=client open_count=1 channel=[id: 0xdcfc0c64, 0.0.0.0/0.0.0.0:53505] timeout=300.0>) 2021-11-22 03:40:39,009 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:40:39,019 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:40:39,020 | infra | DEBUG | pool-3-thread-29 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:41:09,914 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+2100000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "d5fad963-fac8-4dc8-8eec-759b9069a722", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" EOF - cause: EOF"}], "status": "errors", "metrics": {"elapsedTime": "53.461884141s","executionTime": "53.436632768s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 36788,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:41:09,915 | infra | DEBUG | pool-3-thread-7 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:41:09,917 | infra | DEBUG | pool-3-thread-7 | [task:call:6532] Status of the query 0 2021-11-22 03:41:09,917 | infra | INFO | pool-3-thread-7 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:41:09,917 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637581214.93' completed 2021-11-22 03:41:11,825 | infra | DEBUG | pool-3-thread-29 | [task:call:6532] Status of the query 1 2021-11-22 03:41:11,825 | infra | INFO | pool-3-thread-29 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:41:11,825 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637581215.0' completed 2021-11-22 03:42:15,237 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60_default%60.%60_default%60+data+USE+INDEX+%28default__default__default_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+2050000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "7241a5c7-461f-4dcf-ab18-7c7d62db0780", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m0.221248244s","executionTime": "2m0.221028502s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 681360,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:42:15,240 | infra | DEBUG | pool-3-thread-21 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:42:15,240 | infra | DEBUG | pool-3-thread-21 | [task:call:6532] Status of the query 0 2021-11-22 03:42:15,242 | infra | INFO | pool-3-thread-21 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:42:15,242 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637581214.89' completed 2021-11-22 03:42:15,243 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`_default`.`_default` data USE INDEX (default__default__default_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637581214.93 2021-11-22 03:42:15,243 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637581215.0 2021-11-22 03:42:15,243 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:42:15,243 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000 2021-11-22 03:42:15,244 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 50000 2021-11-22 03:42:15,283 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637581335.24 2021-11-22 03:42:15,283 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637581335.24' started 2021-11-22 03:42:15,285 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:42:15,285 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000 2021-11-22 03:42:15,286 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 100000 2021-11-22 03:42:15,323 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call 2021-11-22 03:42:15,335 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637581335.29 2021-11-22 03:42:15,335 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637581335.29' started 2021-11-22 03:42:15,336 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:42:15,336 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000 2021-11-22 03:42:15,336 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 150000 2021-11-22 03:42:15,374 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 03:42:15,374 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637581335.34 2021-11-22 03:42:15,374 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637581335.34' started 2021-11-22 03:42:15,375 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:42:15,375 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:42:15,375 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637581335.24 2021-11-22 03:42:15,407 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a7 type=client open_count=1 channel=[id: 0x3227484e, 0.0.0.0/0.0.0.0:41093] timeout=300.0>) 2021-11-22 03:42:37,779 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:42:37,786 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:42:37,788 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437a8 type=client open_count=1 channel=[id: 0xa4ef2445, 0.0.0.0/0.0.0.0:41428] timeout=300.0>) 2021-11-22 03:43:38,551 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:43:38,559 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:43:38,559 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437a9 type=client open_count=1 channel=[id: 0x17e3fe0d, 0.0.0.0/0.0.0.0:55288] timeout=300.0>) 2021-11-22 03:45:36,739 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:45:36,746 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:45:36,746 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:47:15,411 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:47:15,413 | infra | INFO | pool-3-thread-6 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:47:15,414 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637581335.34' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437aa type=client open_count=1 channel=[id: 0x8f1d0341, 0.0.0.0/0.0.0.0:34934] timeout=300.0>) 2021-11-22 03:48:16,079 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:48:16,081 | infra | INFO | pool-3-thread-20 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:48:16,082 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637581335.24' completed 2021-11-22 03:48:16,082 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637581335.29 2021-11-22 03:48:41,565 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:48:41,565 | infra | INFO | pool-3-thread-19 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:48:41,565 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637581335.29' completed 2021-11-22 03:48:41,566 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637581335.34 2021-11-22 03:48:41,568 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:48:41,568 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000 2021-11-22 03:48:41,569 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 200000 2021-11-22 03:48:41,601 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637581721.57 2021-11-22 03:48:41,601 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637581721.57' started 2021-11-22 03:48:41,601 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:48:41,602 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000 2021-11-22 03:48:41,602 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 250000 2021-11-22 03:48:41,638 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 03:48:41,651 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637581721.6 2021-11-22 03:48:41,651 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637581721.6' started 2021-11-22 03:48:41,653 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:48:41,653 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000 2021-11-22 03:48:41,654 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 300000 2021-11-22 03:48:41,690 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call 2021-11-22 03:48:41,882 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637581721.65 2021-11-22 03:48:41,882 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637581721.65' started 2021-11-22 03:48:41,884 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:48:41,884 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:48:41,884 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637581721.57 2021-11-22 03:48:42,025 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437ab type=client open_count=1 channel=[id: 0xff5c1e8c, 0.0.0.0/0.0.0.0:39918] timeout=300.0>) 2021-11-22 03:50:08,971 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:50:08,979 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:50:08,980 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 03:53:41,642 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 03:53:41,644 | infra | INFO | pool-3-thread-24 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 03:53:41,644 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637581721.57' completed 2021-11-22 03:53:41,644 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637581721.6 2021-11-22 03:53:41,696 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 03:53:41,696 | infra | INFO | pool-3-thread-1 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 03:53:41,697 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637581721.6' completed 2021-11-22 03:53:41,697 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637581721.65 2021-11-22 03:55:11,984 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 03:55:11,986 | infra | INFO | pool-3-thread-30 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 03:55:11,986 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637581721.65' completed 2021-11-22 03:55:11,986 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:55:11,987 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000 2021-11-22 03:55:11,987 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 350000 2021-11-22 03:55:12,029 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637582111.99 2021-11-22 03:55:12,029 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:55:12,030 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000 2021-11-22 03:55:12,030 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637582111.99' started 2021-11-22 03:55:12,030 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 400000 2021-11-22 03:55:12,068 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call 2021-11-22 03:55:12,098 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637582112.03 2021-11-22 03:55:12,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:55:12,098 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637582112.03' started 2021-11-22 03:55:12,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000 2021-11-22 03:55:12,099 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 450000 2021-11-22 03:55:12,134 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call 2021-11-22 03:55:12,361 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637582112.1 2021-11-22 03:55:12,361 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637582112.1' started 2021-11-22 03:55:12,361 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:55:12,362 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:55:12,362 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637582111.99 2021-11-22 03:55:12,496 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 03:57:16,632 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+350000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "434d3df2-3033-4eb1-a524-30caf307b366", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m4.547867393s","executionTime": "2m4.547198671s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 154496,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:57:16,635 | infra | DEBUG | pool-3-thread-23 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:57:16,637 | infra | DEBUG | pool-3-thread-23 | [task:call:6532] Status of the query 0 2021-11-22 03:57:16,637 | infra | INFO | pool-3-thread-23 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:57:16,638 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637582111.99' completed 2021-11-22 03:57:16,638 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637582112.03 2021-11-22 03:57:17,091 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+450000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "79d30cbf-64f8-4af2-b02f-972467fe9acf", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m4.267001111s","executionTime": "2m4.249655424s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 61574,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:57:17,094 | infra | DEBUG | pool-3-thread-28 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:57:17,094 | infra | DEBUG | pool-3-thread-28 | [task:call:6532] Status of the query 0 2021-11-22 03:57:17,095 | infra | INFO | pool-3-thread-28 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:57:17,095 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637582112.1' completed 2021-11-22 03:57:30,668 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+400000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "a4166291-180c-4728-9755-0f1cdbb0f022", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m16.794116198s","executionTime": "2m16.782588325s","resultCount": 0,"resultSize": 0,"serviceLoad": 4,"sortCount": 25364,"errorCount": 1} } auth: Administrator:password 2021-11-22 03:57:30,671 | infra | DEBUG | pool-3-thread-25 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 03:57:30,671 | infra | DEBUG | pool-3-thread-25 | [task:call:6532] Status of the query 0 2021-11-22 03:57:30,671 | infra | INFO | pool-3-thread-25 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 03:57:30,671 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637582112.03' completed 2021-11-22 03:57:30,673 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637582112.1 2021-11-22 03:57:30,674 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 03:57:30,674 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000 2021-11-22 03:57:30,674 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 500000 2021-11-22 03:57:30,717 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637582250.68 2021-11-22 03:57:30,717 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637582250.68' started 2021-11-22 03:57:30,719 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:57:30,719 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000 2021-11-22 03:57:30,720 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 550000 2021-11-22 03:57:30,759 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call 2021-11-22 03:57:30,859 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637582250.72 2021-11-22 03:57:30,859 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637582250.72' started 2021-11-22 03:57:30,859 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:57:30,861 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000 2021-11-22 03:57:30,861 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 600000 2021-11-22 03:57:30,921 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call 2021-11-22 03:57:31,780 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637582250.86 2021-11-22 03:57:31,780 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637582250.86' started 2021-11-22 03:57:31,782 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 03:57:31,782 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 03:57:31,782 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637582250.68 2021-11-22 03:57:32,046 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437ac type=client open_count=1 channel=[id: 0xa8447037, 0.0.0.0/0.0.0.0:36630] timeout=300.0>) 2021-11-22 03:57:44,528 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:57:44,535 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:57:44,536 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437ad type=client open_count=1 channel=[id: 0x411e415c, 0.0.0.0/0.0.0.0:45162] timeout=300.0>) 2021-11-22 03:57:46,605 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:57:46,614 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:57:46,614 | infra | DEBUG | pool-3-thread-27 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ae type=client open_count=1 channel=[id: 0x2747fff1, 0.0.0.0/0.0.0.0:50468] timeout=300.0>) 2021-11-22 03:59:00,910 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 03:59:00,921 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 03:59:00,921 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:02:47,542 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 04:02:47,543 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:02:47,545 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637582250.86' completed 2021-11-22 04:02:49,618 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:02:49,619 | infra | INFO | pool-3-thread-27 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:02:49,619 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637582250.72' completed 2021-11-22 04:04:03,927 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 04:04:03,927 | infra | INFO | pool-3-thread-14 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:04:03,928 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637582250.68' completed 2021-11-22 04:04:03,930 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637582250.72 2021-11-22 04:04:03,930 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637582250.86 2021-11-22 04:04:03,930 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:04:03,930 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000 2021-11-22 04:04:03,931 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 650000 2021-11-22 04:04:03,967 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637582643.93 2021-11-22 04:04:03,967 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637582643.93' started 2021-11-22 04:04:03,969 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:04:03,969 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000 2021-11-22 04:04:03,970 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 700000 2021-11-22 04:04:04,005 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call 2021-11-22 04:04:04,048 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637582643.97 2021-11-22 04:04:04,048 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637582643.97' started 2021-11-22 04:04:04,049 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:04:04,049 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000 2021-11-22 04:04:04,051 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 750000 2021-11-22 04:04:04,094 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call 2021-11-22 04:04:04,164 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637582644.05 2021-11-22 04:04:04,164 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637582644.05' started 2021-11-22 04:04:04,165 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:04:04,167 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:04:04,167 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637582643.93 2021-11-22 04:04:04,226 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437af type=client open_count=1 channel=[id: 0xcec00391, 0.0.0.0/0.0.0.0:45563] timeout=300.0>) 2021-11-22 04:04:15,513 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:04:15,520 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:04:15,522 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:06:15,875 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+700000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "05ad8c40-198a-4c66-8cb3-88b8064b0738", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m10.850058846s","executionTime": "2m10.844227547s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 48790,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:06:15,878 | infra | DEBUG | pool-3-thread-12 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:06:15,878 | infra | DEBUG | pool-3-thread-12 | [task:call:6532] Status of the query 0 2021-11-22 04:06:15,880 | infra | INFO | pool-3-thread-12 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:06:15,880 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637582643.97' completed 2021-11-22 04:06:22,309 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+750000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "a83ad6f7-5258-4ba3-8eca-88954d4c8063", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m15.232751434s","executionTime": "2m15.214729423s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 40596,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:06:22,312 | infra | DEBUG | pool-3-thread-2 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:06:22,313 | infra | DEBUG | pool-3-thread-2 | [task:call:6532] Status of the query 0 2021-11-22 04:06:22,313 | infra | INFO | pool-3-thread-2 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:06:22,315 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637582644.05' completed 2021-11-22 04:06:24,282 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+650000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "09209acc-116c-4fdb-a7e8-ece4abc5b729", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m5.74305903s","executionTime": "2m5.742647907s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 152966,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:06:24,283 | infra | DEBUG | pool-3-thread-9 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:06:24,283 | infra | DEBUG | pool-3-thread-9 | [task:call:6532] Status of the query 0 2021-11-22 04:06:24,285 | infra | INFO | pool-3-thread-9 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:06:24,285 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637582643.93' completed 2021-11-22 04:06:24,286 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637582643.97 2021-11-22 04:06:24,286 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637582644.05 2021-11-22 04:06:24,286 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:06:24,288 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000 2021-11-22 04:06:24,288 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 800000 2021-11-22 04:06:24,325 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637582784.29 2021-11-22 04:06:24,325 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637582784.29' started 2021-11-22 04:06:24,325 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:06:24,326 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000 2021-11-22 04:06:24,326 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 850000 2021-11-22 04:06:24,357 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call 2021-11-22 04:06:24,443 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637582784.33 2021-11-22 04:06:24,443 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637582784.33' started 2021-11-22 04:06:24,444 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:06:24,444 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000 2021-11-22 04:06:24,444 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 900000 2021-11-22 04:06:24,526 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call 2021-11-22 04:06:24,839 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637582784.44 2021-11-22 04:06:24,839 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637582784.44' started 2021-11-22 04:06:24,839 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:06:24,841 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:06:24,841 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637582784.29 2021-11-22 04:06:24,951 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437b0 type=client open_count=1 channel=[id: 0x06f420c1, 0.0.0.0/0.0.0.0:42409] timeout=300.0>) 2021-11-22 04:06:36,273 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:06:36,282 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:06:36,282 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437b1 type=client open_count=1 channel=[id: 0x61af47bd, 0.0.0.0/0.0.0.0:39752] timeout=300.0>) 2021-11-22 04:07:42,951 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:07:42,959 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:07:42,960 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437b2 type=client open_count=1 channel=[id: 0x095842dd, 0.0.0.0/0.0.0.0:37990] timeout=300.0>) 2021-11-22 04:07:47,803 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:07:47,811 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:07:47,812 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:11:39,288 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 04:11:39,289 | infra | INFO | pool-3-thread-17 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:11:39,289 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637582784.44' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437b3 type=client open_count=1 channel=[id: 0x442c7894, 0.0.0.0/0.0.0.0:51585] timeout=300.0>) 2021-11-22 04:11:59,428 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:11:59,430 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:11:59,430 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637582784.29' completed 2021-11-22 04:11:59,430 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637582784.33 2021-11-22 04:12:50,816 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:12:50,818 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:12:50,819 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637582784.33' completed 2021-11-22 04:12:50,819 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637582784.44 2021-11-22 04:12:50,819 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:12:50,819 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000 2021-11-22 04:12:50,821 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 950000 2021-11-22 04:12:50,855 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637583170.82 2021-11-22 04:12:50,855 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637583170.82' started 2021-11-22 04:12:50,857 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:12:50,858 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000 2021-11-22 04:12:50,858 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1000000 2021-11-22 04:12:50,895 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call 2021-11-22 04:12:50,903 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637583170.86 2021-11-22 04:12:50,904 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637583170.86' started 2021-11-22 04:12:50,904 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:12:50,904 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000 2021-11-22 04:12:50,904 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1050000 2021-11-22 04:12:50,956 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call 2021-11-22 04:12:51,002 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637583170.9 2021-11-22 04:12:51,002 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637583170.9' started 2021-11-22 04:12:51,003 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:12:51,003 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:12:51,003 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637583170.82 2021-11-22 04:12:51,038 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437b4 type=client open_count=1 channel=[id: 0x88d3c579, 0.0.0.0/0.0.0.0:59381] timeout=300.0>) 2021-11-22 04:14:03,105 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:14:03,114 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:14:03,114 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437b5 type=client open_count=1 channel=[id: 0xd455f2da, 0.0.0.0/0.0.0.0:54900] timeout=300.0>) 2021-11-22 04:15:18,923 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:15:18,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:15:18,930 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437b6 type=client open_count=1 channel=[id: 0xfd545b78, 0.0.0.0/0.0.0.0:32877] timeout=300.0>) 2021-11-22 04:15:28,440 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:15:28,448 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:15:28,450 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437b7 type=client open_count=1 channel=[id: 0xc21a3416, 0.0.0.0/0.0.0.0:54108] timeout=300.0>) 2021-11-22 04:18:22,581 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:18:22,582 | infra | INFO | pool-3-thread-3 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:18:22,582 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637583170.9' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437b8 type=client open_count=1 channel=[id: 0x0424ac76, 0.0.0.0/0.0.0.0:54096] timeout=300.0>) 2021-11-22 04:18:28,032 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:18:28,039 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:18:28,039 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637583170.82' completed 2021-11-22 04:18:28,039 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637583170.86 2021-11-22 04:20:21,936 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:20:21,937 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:20:21,937 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637583170.86' completed 2021-11-22 04:20:21,937 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637583170.9 2021-11-22 04:20:21,937 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:20:21,938 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000 2021-11-22 04:20:21,938 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1100000 2021-11-22 04:20:21,977 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637583621.94' started 2021-11-22 04:20:21,977 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637583621.94 2021-11-22 04:20:21,979 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:20:21,980 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000 2021-11-22 04:20:21,980 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1150000 2021-11-22 04:20:22,013 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call 2021-11-22 04:20:22,059 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637583621.98 2021-11-22 04:20:22,059 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637583621.98' started 2021-11-22 04:20:22,059 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:20:22,059 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000 2021-11-22 04:20:22,059 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1200000 2021-11-22 04:20:22,105 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 04:20:22,108 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637583622.06 2021-11-22 04:20:22,108 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637583622.06' started 2021-11-22 04:20:22,109 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:20:22,109 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:20:22,111 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637583621.94 2021-11-22 04:20:22,142 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437b9 type=client open_count=1 channel=[id: 0x573ea12c, 0.0.0.0/0.0.0.0:36461] timeout=300.0>) 2021-11-22 04:20:50,335 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:20:50,345 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:20:50,345 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ba type=client open_count=1 channel=[id: 0xb586b9ae, 0.0.0.0/0.0.0.0:48212] timeout=300.0>) 2021-11-22 04:22:02,433 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:22:02,440 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:22:02,440 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437bb type=client open_count=1 channel=[id: 0x034d3970, 0.0.0.0/0.0.0.0:56085] timeout=300.0>) 2021-11-22 04:24:23,730 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:24:23,737 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:24:23,737 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:25:22,148 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 04:25:22,148 | infra | INFO | pool-3-thread-18 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:25:22,148 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637583622.06' completed 2021-11-22 04:25:53,354 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:25:53,354 | infra | INFO | pool-3-thread-10 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:25:53,355 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637583621.98' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437bc type=client open_count=1 channel=[id: 0xf9706760, 0.0.0.0/0.0.0.0:47764] timeout=300.0>) 2021-11-22 04:27:51,299 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:27:51,301 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:27:51,301 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637583621.94' completed 2021-11-22 04:27:51,302 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637583621.98 2021-11-22 04:27:51,302 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637583622.06 2021-11-22 04:27:51,302 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:27:51,302 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000 2021-11-22 04:27:51,303 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1250000 2021-11-22 04:27:51,346 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637584071.3 2021-11-22 04:27:51,346 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637584071.3' started 2021-11-22 04:27:51,348 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:27:51,348 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000 2021-11-22 04:27:51,348 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1300000 2021-11-22 04:27:51,382 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437bd type=client open_count=1 channel=[id: 0x47e651f5, 0.0.0.0/0.0.0.0:55566] timeout=300.0>) 2021-11-22 04:27:51,388 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:27:51,395 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:27:51,397 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:27:51,401 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637584071.35 2021-11-22 04:27:51,401 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637584071.35' started 2021-11-22 04:27:51,401 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:27:51,401 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000 2021-11-22 04:27:51,401 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1350000 2021-11-22 04:27:51,438 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call 2021-11-22 04:27:51,615 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637584071.4' started 2021-11-22 04:27:51,615 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637584071.4 2021-11-22 04:27:51,617 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:27:51,618 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:27:51,618 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637584071.3 2021-11-22 04:27:51,670 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437be type=client open_count=1 channel=[id: 0x86c8ec23, 0.0.0.0/0.0.0.0:34513] timeout=300.0>) 2021-11-22 04:28:45,463 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:28:45,470 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:28:45,470 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437bf type=client open_count=1 channel=[id: 0x120f1a98, 0.0.0.0/0.0.0.0:46783] timeout=300.0>) 2021-11-22 04:29:38,443 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:29:38,450 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:29:38,450 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:29:58,368 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1300000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "4f042ab8-352c-491a-808c-811834cb91af", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m6.615992069s","executionTime": "2m6.586004878s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 117130,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:29:58,371 | infra | DEBUG | pool-3-thread-16 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:29:58,371 | infra | DEBUG | pool-3-thread-16 | [task:call:6532] Status of the query 0 2021-11-22 04:29:58,371 | infra | INFO | pool-3-thread-16 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:29:58,371 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637584071.35' completed 2021-11-22 04:30:50,917 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1350000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "f428ad1a-4fca-4ae5-a4c2-33ed21b74a05", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m2.418062175s","executionTime": "2m2.417848376s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 510000,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:30:50,920 | infra | DEBUG | pool-3-thread-4 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:30:50,921 | infra | DEBUG | pool-3-thread-4 | [task:call:6532] Status of the query 0 2021-11-22 04:30:50,921 | infra | INFO | pool-3-thread-4 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:30:50,921 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637584071.4' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c0 type=client open_count=1 channel=[id: 0xc53a599e, 0.0.0.0/0.0.0.0:57649] timeout=300.0>) 2021-11-22 04:31:19,351 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:31:19,358 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:31:19,358 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c1 type=client open_count=1 channel=[id: 0xcf56ecc1, 0.0.0.0/0.0.0.0:56509] timeout=300.0>) 2021-11-22 04:32:44,213 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:32:44,221 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:32:44,221 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c2 type=client open_count=1 channel=[id: 0x9420d371, 0.0.0.0/0.0.0.0:53764] timeout=300.0>) 2021-11-22 04:33:31,734 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:33:31,734 | infra | INFO | pool-3-thread-15 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:33:31,736 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637584071.3' completed 2021-11-22 04:33:31,736 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637584071.35 2021-11-22 04:33:31,736 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637584071.4 2021-11-22 04:33:31,736 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:33:31,737 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000 2021-11-22 04:33:31,737 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1400000 2021-11-22 04:33:31,778 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637584411.74 2021-11-22 04:33:31,778 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637584411.74' started 2021-11-22 04:33:31,779 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:33:31,779 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000 2021-11-22 04:33:31,779 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1450000 2021-11-22 04:33:31,818 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call 2021-11-22 04:33:31,819 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637584411.78' started 2021-11-22 04:33:31,819 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637584411.78 2021-11-22 04:33:31,819 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:33:31,821 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000 2021-11-22 04:33:31,822 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1500000 Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c3 type=client open_count=1 channel=[id: 0x73016085, 0.0.0.0/0.0.0.0:55940] timeout=300.0>) 2021-11-22 04:33:31,823 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:33:31,832 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:33:31,832 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:33:31,859 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call 2021-11-22 04:33:31,862 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637584411.82 2021-11-22 04:33:31,862 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637584411.82' started 2021-11-22 04:33:31,862 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:33:31,864 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:33:31,865 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637584411.74 2021-11-22 04:33:31,903 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c4 type=client open_count=1 channel=[id: 0x9e580d7d, 0.0.0.0/0.0.0.0:34826] timeout=300.0>) 2021-11-22 04:34:41,622 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:34:41,631 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:34:41,631 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c5 type=client open_count=1 channel=[id: 0x16911806, 0.0.0.0/0.0.0.0:38269] timeout=300.0>) 2021-11-22 04:37:14,042 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:37:14,049 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:37:14,049 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:38:31,865 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:38:31,865 | infra | INFO | pool-3-thread-29 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:38:31,867 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637584411.78' completed 2021-11-22 04:38:31,907 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 04:38:31,907 | infra | INFO | pool-3-thread-21 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:38:31,908 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637584411.82' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c6 type=client open_count=1 channel=[id: 0xb009e249, 0.0.0.0/0.0.0.0:55264] timeout=300.0>) 2021-11-22 04:40:06,453 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:40:06,454 | infra | INFO | pool-3-thread-7 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:40:06,454 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637584411.74' completed 2021-11-22 04:40:06,456 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637584411.78 2021-11-22 04:40:06,456 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637584411.82 2021-11-22 04:40:06,457 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:40:06,457 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000 2021-11-22 04:40:06,457 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1550000 2021-11-22 04:40:06,503 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637584806.46 2021-11-22 04:40:06,503 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637584806.46' started 2021-11-22 04:40:06,505 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:40:06,505 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000 2021-11-22 04:40:06,506 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1600000 2021-11-22 04:40:06,542 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c7 type=client open_count=1 channel=[id: 0xa7e0c439, 0.0.0.0/0.0.0.0:42310] timeout=300.0>) 2021-11-22 04:40:06,546 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637584806.51 2021-11-22 04:40:06,546 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637584806.51' started 2021-11-22 04:40:06,546 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:40:06,546 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000 2021-11-22 04:40:06,548 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1650000 2021-11-22 04:40:06,548 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:40:06,559 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:40:06,559 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:40:06,589 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call 2021-11-22 04:40:06,805 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637584806.55 2021-11-22 04:40:06,805 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637584806.55' started 2021-11-22 04:40:06,805 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:40:06,806 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:40:06,806 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637584806.46 2021-11-22 04:40:06,946 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 04:42:13,404 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1550000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "fcb982d0-2a66-457e-b427-d4866df5d958", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m3.823521555s","executionTime": "2m3.823230001s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 168232,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:42:13,405 | infra | DEBUG | pool-3-thread-6 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:42:13,407 | infra | DEBUG | pool-3-thread-6 | [task:call:6532] Status of the query 0 2021-11-22 04:42:13,407 | infra | INFO | pool-3-thread-6 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:42:13,407 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637584806.46' completed 2021-11-22 04:42:13,408 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637584806.51 2021-11-22 04:42:17,585 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1650000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "1b4833df-55c9-43ef-b819-44b60d911807", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m8.978939959s","executionTime": "2m8.943880859s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 49742,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:42:17,586 | infra | DEBUG | pool-3-thread-19 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:42:17,588 | infra | DEBUG | pool-3-thread-19 | [task:call:6532] Status of the query 0 2021-11-22 04:42:17,588 | infra | INFO | pool-3-thread-19 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:42:17,589 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637584806.55' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437c8 type=client open_count=1 channel=[id: 0xabed410d, 0.0.0.0/0.0.0.0:56895] timeout=300.0>) 2021-11-22 04:44:18,276 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:44:18,285 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:44:18,285 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:49:21,290 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:49:21,292 | infra | INFO | pool-3-thread-20 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:49:21,292 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637584806.51' completed 2021-11-22 04:49:21,292 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637584806.55 2021-11-22 04:49:21,293 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:49:21,293 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000 2021-11-22 04:49:21,293 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1700000 2021-11-22 04:49:21,336 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637585361.3 2021-11-22 04:49:21,336 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637585361.3' started 2021-11-22 04:49:21,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:49:21,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000 2021-11-22 04:49:21,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1750000 2021-11-22 04:49:21,375 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 04:49:21,417 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637585361.34 2021-11-22 04:49:21,417 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637585361.34' started 2021-11-22 04:49:21,418 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:49:21,418 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000 2021-11-22 04:49:21,420 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1800000 2021-11-22 04:49:21,456 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637585361.42 2021-11-22 04:49:21,456 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637585361.42' started 2021-11-22 04:49:21,456 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:49:21,457 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:49:21,457 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637585361.3 2021-11-22 04:49:21,467 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call 2021-11-22 04:49:21,493 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call 2021-11-22 04:51:26,552 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1800000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "e557a08f-3b7a-4042-948a-23c039249697", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m4.803719865s","executionTime": "2m4.803522051s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 429726,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:51:26,555 | infra | DEBUG | pool-3-thread-30 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:51:26,556 | infra | DEBUG | pool-3-thread-30 | [task:call:6532] Status of the query 0 2021-11-22 04:51:26,556 | infra | INFO | pool-3-thread-30 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:51:26,558 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637585361.42' completed 2021-11-22 04:51:31,834 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1700000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "b5dabeea-60c7-46f6-b332-353a66a1d476", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m10.337989614s","executionTime": "2m10.337825249s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 455600,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:51:31,835 | infra | DEBUG | pool-3-thread-24 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:51:31,836 | infra | DEBUG | pool-3-thread-24 | [task:call:6532] Status of the query 0 2021-11-22 04:51:31,836 | infra | INFO | pool-3-thread-24 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:51:31,838 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637585361.3' completed 2021-11-22 04:51:31,838 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637585361.34 2021-11-22 04:51:34,436 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1750000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "3856672e-0a3e-47e4-b083-5842e563ee76", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m12.818522016s","executionTime": "2m12.756091356s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 46172,"errorCount": 1} } auth: Administrator:password 2021-11-22 04:51:34,437 | infra | DEBUG | pool-3-thread-1 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 04:51:34,438 | infra | DEBUG | pool-3-thread-1 | [task:call:6532] Status of the query 0 2021-11-22 04:51:34,438 | infra | INFO | pool-3-thread-1 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 04:51:34,440 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637585361.34' completed 2021-11-22 04:51:34,440 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637585361.42 2021-11-22 04:51:34,440 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:51:34,441 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000 2021-11-22 04:51:34,443 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1850000 2021-11-22 04:51:34,483 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637585494.44' started 2021-11-22 04:51:34,483 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637585494.44 2021-11-22 04:51:34,484 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:51:34,484 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000 2021-11-22 04:51:34,486 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1900000 2021-11-22 04:51:34,529 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call 2021-11-22 04:51:34,532 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637585494.49 2021-11-22 04:51:34,532 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637585494.49' started 2021-11-22 04:51:34,532 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:51:34,533 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000 2021-11-22 04:51:34,533 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1950000 2021-11-22 04:51:34,572 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 04:51:34,654 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637585494.54 2021-11-22 04:51:34,655 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637585494.54' started 2021-11-22 04:51:34,655 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:51:34,657 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:51:34,657 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637585494.44 2021-11-22 04:51:34,698 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437c9 type=client open_count=1 channel=[id: 0x1e37ee8f, 0.0.0.0/0.0.0.0:50407] timeout=300.0>) 2021-11-22 04:52:08,322 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:52:08,328 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:52:08,329 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437ca type=client open_count=1 channel=[id: 0x2b0b7b92, 0.0.0.0/0.0.0.0:38133] timeout=300.0>) 2021-11-22 04:52:23,526 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:52:23,539 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:52:23,539 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437cb type=client open_count=1 channel=[id: 0x16957474, 0.0.0.0/0.0.0.0:36850] timeout=300.0>) 2021-11-22 04:52:26,545 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:52:26,553 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:52:26,553 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437cc type=client open_count=1 channel=[id: 0x916b0289, 0.0.0.0/0.0.0.0:42943] timeout=300.0>) 2021-11-22 04:54:24,052 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:54:24,059 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:54:24,059 | infra | DEBUG | pool-3-thread-23 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:56:34,704 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 04:56:34,706 | infra | INFO | pool-3-thread-25 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 04:56:34,706 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637585494.54' completed 2021-11-22 04:57:29,559 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 04:57:29,562 | infra | INFO | pool-3-thread-28 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 04:57:29,562 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637585494.49' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437cd type=client open_count=1 channel=[id: 0xf6e2d93a, 0.0.0.0/0.0.0.0:34008] timeout=300.0>) 2021-11-22 04:59:21,773 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:59:21,776 | infra | INFO | pool-3-thread-23 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 04:59:21,778 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637585494.44' completed 2021-11-22 04:59:21,779 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637585494.49 2021-11-22 04:59:21,779 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637585494.54 2021-11-22 04:59:21,779 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 04:59:21,780 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000 2021-11-22 04:59:21,782 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2000000 2021-11-22 04:59:21,821 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637585961.78' started 2021-11-22 04:59:21,821 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637585961.78 2021-11-22 04:59:21,822 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:59:21,822 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000 2021-11-22 04:59:21,822 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2050000 2021-11-22 04:59:21,859 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ce type=client open_count=1 channel=[id: 0xe3aaf78f, 0.0.0.0/0.0.0.0:36287] timeout=300.0>) 2021-11-22 04:59:21,865 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 04:59:21,874 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 04:59:21,874 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 04:59:21,884 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637585961.82 2021-11-22 04:59:21,884 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637585961.82' started 2021-11-22 04:59:21,884 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:59:21,885 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000 2021-11-22 04:59:21,885 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2100000 2021-11-22 04:59:21,930 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call 2021-11-22 04:59:22,092 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637585961.89 2021-11-22 04:59:22,092 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637585961.89' started 2021-11-22 04:59:22,092 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 04:59:22,092 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 04:59:22,094 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637585961.78 2021-11-22 04:59:22,137 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call 2021-11-22 05:01:29,477 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+2100000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "2171ddc6-b933-44af-ac0a-add91ade8b4c", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m6.638950699s","executionTime": "2m6.373322757s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 33830,"errorCount": 1} } auth: Administrator:password 2021-11-22 05:01:29,480 | infra | DEBUG | pool-3-thread-14 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 05:01:29,482 | infra | DEBUG | pool-3-thread-14 | [task:call:6532] Status of the query 0 2021-11-22 05:01:29,482 | infra | INFO | pool-3-thread-14 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 05:01:29,483 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637585961.89' completed 2021-11-22 05:01:37,835 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection1%60+data+USE+INDEX+%28default_Scope1_FunctionCollection1_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+2050000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "d653d4e4-2deb-4465-80bc-2698202a67a7", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m14.086480441s","executionTime": "2m13.525393808s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 55590,"errorCount": 1} } auth: Administrator:password 2021-11-22 05:01:37,836 | infra | DEBUG | pool-3-thread-27 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 05:01:37,838 | infra | DEBUG | pool-3-thread-27 | [task:call:6532] Status of the query 0 2021-11-22 05:01:37,838 | infra | INFO | pool-3-thread-27 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 05:01:37,838 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637585961.82' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437cf type=client open_count=1 channel=[id: 0x03c36d25, 0.0.0.0/0.0.0.0:33432] timeout=300.0>) 2021-11-22 05:03:00,591 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:03:00,601 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:03:00,601 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437d0 type=client open_count=1 channel=[id: 0x26788384, 0.0.0.0/0.0.0.0:36761] timeout=300.0>) 2021-11-22 05:06:16,134 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:06:16,135 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:06:16,137 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637585961.78' completed 2021-11-22 05:06:16,137 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637585961.82 2021-11-22 05:06:16,138 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection1` data USE INDEX (default_Scope1_FunctionCollection1_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637585961.89 2021-11-22 05:06:16,138 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:06:16,138 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0 2021-11-22 05:06:16,138 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 0 2021-11-22 05:06:16,180 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637586376.14' started 2021-11-22 05:06:16,180 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637586376.14 2021-11-22 05:06:16,180 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:06:16,180 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000 2021-11-22 05:06:16,180 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 50000 2021-11-22 05:06:16,219 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437d1 type=client open_count=1 channel=[id: 0x8ad3c759, 0.0.0.0/0.0.0.0:52593] timeout=300.0>) 2021-11-22 05:06:16,223 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:06:16,233 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:06:16,233 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:06:16,234 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637586376.18 2021-11-22 05:06:16,234 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637586376.18' started 2021-11-22 05:06:16,234 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:06:16,236 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000 2021-11-22 05:06:16,236 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 100000 2021-11-22 05:06:16,276 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call 2021-11-22 05:06:16,309 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637586376.24' started 2021-11-22 05:06:16,309 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637586376.24 2021-11-22 05:06:16,309 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:06:16,309 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:06:16,311 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637586376.14 2021-11-22 05:06:16,352 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437d2 type=client open_count=1 channel=[id: 0xbeb86551, 0.0.0.0/0.0.0.0:59469] timeout=300.0>) 2021-11-22 05:06:16,358 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:06:16,365 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:06:16,367 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:08:38,180 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection0%60+data+USE+INDEX+%28default_Scope1_FunctionCollection0_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+50000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "57cdd872-368b-416e-b248-460f91e4bdd7", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m19.8363156s","executionTime": "2m19.814569027s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 33830,"errorCount": 1} } auth: Administrator:password 2021-11-22 05:08:38,181 | infra | DEBUG | pool-3-thread-2 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 05:08:38,183 | infra | DEBUG | pool-3-thread-2 | [task:call:6532] Status of the query 0 2021-11-22 05:08:38,183 | infra | INFO | pool-3-thread-2 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 05:08:38,184 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637586376.18' completed 2021-11-22 05:10:28,707 | infra | DEBUG | pool-3-thread-9 | [task:call:6532] Status of the query 1 2021-11-22 05:10:28,707 | infra | INFO | pool-3-thread-9 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 05:10:28,709 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637586376.24' completed 2021-11-22 05:11:19,240 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error timed out 2021-11-22 05:11:19,242 | infra | INFO | pool-3-thread-12 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:11:19,242 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 0started1637586376.14' completed 2021-11-22 05:11:19,243 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 50000started1637586376.18 2021-11-22 05:11:19,243 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 100000started1637586376.24 2021-11-22 05:11:19,243 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:11:19,244 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000 2021-11-22 05:11:19,246 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 150000 2021-11-22 05:11:19,289 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637586679.25 2021-11-22 05:11:19,289 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637586679.25' started 2021-11-22 05:11:19,289 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:11:19,289 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000 2021-11-22 05:11:19,290 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 200000 2021-11-22 05:11:19,328 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call 2021-11-22 05:11:19,644 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637586679.29' started 2021-11-22 05:11:19,644 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637586679.29 2021-11-22 05:11:19,644 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:11:19,644 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000 2021-11-22 05:11:19,645 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 250000 2021-11-22 05:11:19,694 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call 2021-11-22 05:11:19,756 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637586679.65' started 2021-11-22 05:11:19,756 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637586679.65 2021-11-22 05:11:19,756 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:11:19,756 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:11:19,757 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637586679.25 2021-11-22 05:11:19,829 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437d3 type=client open_count=1 channel=[id: 0x920c8628, 0.0.0.0/0.0.0.0:48418] timeout=300.0>) 2021-11-22 05:11:35,576 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:11:35,585 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:11:35,585 | infra | DEBUG | pool-3-thread-26 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437d4 type=client open_count=1 channel=[id: 0x36f72a9d, 0.0.0.0/0.0.0.0:43734] timeout=300.0>) 2021-11-22 05:14:18,387 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:14:18,397 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:14:18,398 | infra | DEBUG | pool-3-thread-17 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:16:19,835 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:16:19,836 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:16:19,838 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637586679.65' completed 2021-11-22 05:16:38,591 | infra | ERROR | pool-3-thread-26 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:16:38,592 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:16:38,592 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637586679.29' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437d5 type=client open_count=1 channel=[id: 0x5d7d7974, 0.0.0.0/0.0.0.0:49903] timeout=300.0>) 2021-11-22 05:17:22,096 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:17:22,096 | infra | INFO | pool-3-thread-17 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:17:22,098 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 150000started1637586679.25' completed 2021-11-22 05:17:22,098 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 200000started1637586679.29 2021-11-22 05:17:22,098 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 250000started1637586679.65 2021-11-22 05:17:22,099 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:17:22,099 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000 2021-11-22 05:17:22,099 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 300000 2021-11-22 05:17:22,132 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637587042.1 2021-11-22 05:17:22,132 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637587042.1' started 2021-11-22 05:17:22,134 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:17:22,134 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000 2021-11-22 05:17:22,135 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 350000 2021-11-22 05:17:22,174 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437d6 type=client open_count=1 channel=[id: 0x2e1e3ab3, 0.0.0.0/0.0.0.0:52621] timeout=300.0>) 2021-11-22 05:17:22,190 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:17:22,198 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:17:22,198 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:17:22,296 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637587042.14 2021-11-22 05:17:22,296 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637587042.14' started 2021-11-22 05:17:22,296 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:17:22,296 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000 2021-11-22 05:17:22,298 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 400000 2021-11-22 05:17:22,336 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call 2021-11-22 05:17:22,438 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637587042.3 2021-11-22 05:17:22,438 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637587042.3' started 2021-11-22 05:17:22,440 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:17:22,440 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:17:22,440 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637587042.1 2021-11-22 05:17:22,484 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437d7 type=client open_count=1 channel=[id: 0x132d506c, 0.0.0.0/0.0.0.0:52755] timeout=300.0>) 2021-11-22 05:18:19,220 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:18:19,226 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:18:19,227 | infra | DEBUG | pool-3-thread-22 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437d8 type=client open_count=1 channel=[id: 0x1bce2b5f, 0.0.0.0/0.0.0.0:60592] timeout=300.0>) 2021-11-22 05:19:47,065 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:19:47,075 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:19:47,075 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437d9 type=client open_count=1 channel=[id: 0xd789384a, 0.0.0.0/0.0.0.0:60475] timeout=300.0>) 2021-11-22 05:19:50,081 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:19:50,088 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:19:50,088 | infra | DEBUG | pool-3-thread-8 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437da type=client open_count=1 channel=[id: 0x0a10e6be, 0.0.0.0/0.0.0.0:34029] timeout=300.0>) 2021-11-22 05:19:58,618 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:19:58,625 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:19:58,625 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437db type=client open_count=1 channel=[id: 0xd2e2b50e, 0.0.0.0/0.0.0.0:49444] timeout=300.0>) 2021-11-22 05:23:02,447 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:23:02,447 | infra | INFO | pool-3-thread-3 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:23:02,447 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 300000started1637587042.1' completed 2021-11-22 05:23:02,448 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637587042.14 2021-11-22 05:23:22,233 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:23:22,233 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:23:22,234 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637587042.3' completed 2021-11-22 05:24:53,094 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:24:53,095 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:24:53,095 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 350000started1637587042.14' completed 2021-11-22 05:24:53,096 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 400000started1637587042.3 2021-11-22 05:24:53,096 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:24:53,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000 2021-11-22 05:24:53,098 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 450000 2021-11-22 05:24:53,144 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637587493.1 2021-11-22 05:24:53,144 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637587493.1' started 2021-11-22 05:24:53,144 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:24:53,145 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000 2021-11-22 05:24:53,145 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 500000 2021-11-22 05:24:53,186 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call 2021-11-22 05:24:53,220 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637587493.15 2021-11-22 05:24:53,221 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637587493.15' started 2021-11-22 05:24:53,221 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:24:53,223 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000 2021-11-22 05:24:53,223 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 550000 2021-11-22 05:24:53,259 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 05:24:53,480 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637587493.22 2021-11-22 05:24:53,480 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637587493.22' started 2021-11-22 05:24:53,482 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:24:53,482 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:24:53,483 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637587493.1 2021-11-22 05:24:53,546 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437dc type=client open_count=1 channel=[id: 0x34b8e404, 0.0.0.0/0.0.0.0:48730] timeout=300.0>) 2021-11-22 05:25:59,492 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:25:59,503 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:25:59,505 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437dd type=client open_count=1 channel=[id: 0x8bdf27ae, 0.0.0.0/0.0.0.0:45299] timeout=300.0>) 2021-11-22 05:27:09,609 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:27:09,618 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:27:09,618 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:29:53,266 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:29:53,266 | infra | INFO | pool-3-thread-10 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:29:53,266 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637587493.15' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437de type=client open_count=1 channel=[id: 0x2f500a19, 0.0.0.0/0.0.0.0:42501] timeout=300.0>) 2021-11-22 05:30:43,201 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:30:43,203 | infra | INFO | pool-3-thread-18 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:30:43,203 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 450000started1637587493.1' completed 2021-11-22 05:30:43,204 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 500000started1637587493.15 2021-11-22 05:30:43,204 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637587493.22 2021-11-22 05:31:02,509 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:31:02,509 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:31:02,510 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 550000started1637587493.22' completed 2021-11-22 05:31:02,510 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:31:02,512 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000 2021-11-22 05:31:02,512 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 600000 2021-11-22 05:31:02,548 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637587862.51 2021-11-22 05:31:02,548 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637587862.51' started 2021-11-22 05:31:02,548 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:31:02,549 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000 2021-11-22 05:31:02,549 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 650000 2021-11-22 05:31:02,588 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call 2021-11-22 05:31:02,628 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637587862.55 2021-11-22 05:31:02,628 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637587862.55' started 2021-11-22 05:31:02,628 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:31:02,630 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000 2021-11-22 05:31:02,630 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 700000 2021-11-22 05:31:02,663 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call 2021-11-22 05:31:02,698 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637587862.63 2021-11-22 05:31:02,700 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637587862.63' started 2021-11-22 05:31:02,700 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:31:02,700 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:31:02,700 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637587862.51 2021-11-22 05:31:02,736 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437df type=client open_count=1 channel=[id: 0x2403ec46, 0.0.0.0/0.0.0.0:34643] timeout=300.0>) 2021-11-22 05:32:05,848 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:32:05,855 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:32:05,855 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437e0 type=client open_count=1 channel=[id: 0xac5e1237, 0.0.0.0/0.0.0.0:33908] timeout=300.0>) 2021-11-22 05:32:23,690 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:32:23,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:32:23,700 | infra | DEBUG | pool-3-thread-15 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437e1 type=client open_count=1 channel=[id: 0x4396213e, 0.0.0.0/0.0.0.0:34734] timeout=300.0>) 2021-11-22 05:33:18,977 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:33:18,986 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:33:18,986 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437e2 type=client open_count=1 channel=[id: 0x0dacdc7e, 0.0.0.0/0.0.0.0:37905] timeout=300.0>) 2021-11-22 05:36:21,585 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:36:21,585 | infra | INFO | pool-3-thread-16 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:36:21,585 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 600000started1637587862.51' completed 2021-11-22 05:36:21,586 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637587862.55 2021-11-22 05:37:08,862 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:37:08,864 | infra | INFO | pool-3-thread-4 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:37:08,865 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 650000started1637587862.55' completed 2021-11-22 05:37:08,865 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637587862.63 2021-11-22 05:37:26,706 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:37:26,707 | infra | INFO | pool-3-thread-15 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:37:26,707 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 700000started1637587862.63' completed 2021-11-22 05:37:26,707 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:37:26,709 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000 2021-11-22 05:37:26,709 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 750000 2021-11-22 05:37:26,746 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637588246.71' started 2021-11-22 05:37:26,746 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637588246.71 2021-11-22 05:37:26,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:37:26,747 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000 2021-11-22 05:37:26,747 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 800000 2021-11-22 05:37:26,783 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call 2021-11-22 05:37:26,829 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637588246.75 2021-11-22 05:37:26,829 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637588246.75' started 2021-11-22 05:37:26,831 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:37:26,832 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000 2021-11-22 05:37:26,832 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 850000 2021-11-22 05:37:26,875 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call 2021-11-22 05:37:26,900 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637588246.83 2021-11-22 05:37:26,900 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637588246.83' started 2021-11-22 05:37:26,900 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:37:26,901 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:37:26,901 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637588246.71 2021-11-22 05:37:26,940 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437e3 type=client open_count=1 channel=[id: 0x3043b796, 0.0.0.0/0.0.0.0:46354] timeout=300.0>) 2021-11-22 05:38:06,335 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:38:06,342 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:38:06,344 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437e4 type=client open_count=1 channel=[id: 0x0caca08b, 0.0.0.0/0.0.0.0:39175] timeout=300.0>) 2021-11-22 05:39:37,009 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:39:37,016 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:39:37,016 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:39:44,926 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection0%60+data+USE+INDEX+%28default_Scope1_FunctionCollection0_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+750000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "9d5c524e-21a0-4c97-b111-732f6e13649f", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m18.104357631s","executionTime": "2m18.104082163s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 504424,"errorCount": 1} } auth: Administrator:password 2021-11-22 05:39:44,927 | infra | DEBUG | pool-3-thread-29 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 05:39:44,927 | infra | DEBUG | pool-3-thread-29 | [task:call:6532] Status of the query 0 2021-11-22 05:39:44,928 | infra | INFO | pool-3-thread-29 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 05:39:44,928 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 750000started1637588246.71' completed 2021-11-22 05:39:44,930 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637588246.75 2021-11-22 05:43:09,348 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:43:09,349 | infra | INFO | pool-3-thread-7 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:43:09,349 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637588246.83' completed 2021-11-22 05:44:40,022 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:44:40,023 | infra | INFO | pool-3-thread-21 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:44:40,023 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 800000started1637588246.75' completed 2021-11-22 05:44:40,025 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 850000started1637588246.83 2021-11-22 05:44:40,025 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:44:40,026 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000 2021-11-22 05:44:40,026 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 900000 2021-11-22 05:44:40,062 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637588680.03 2021-11-22 05:44:40,062 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637588680.03' started 2021-11-22 05:44:40,062 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:44:40,063 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000 2021-11-22 05:44:40,063 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 950000 2021-11-22 05:44:40,101 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call 2021-11-22 05:44:40,119 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637588680.07 2021-11-22 05:44:40,121 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637588680.07' started 2021-11-22 05:44:40,121 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:44:40,121 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000 2021-11-22 05:44:40,121 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1000000 2021-11-22 05:44:40,161 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 05:44:40,253 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637588680.12 2021-11-22 05:44:40,255 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637588680.12' started 2021-11-22 05:44:40,255 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:44:40,256 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:44:40,256 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637588680.03 2021-11-22 05:44:40,515 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437e5 type=client open_count=1 channel=[id: 0x9a77b5bb, 0.0.0.0/0.0.0.0:52239] timeout=300.0>) 2021-11-22 05:44:52,101 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:44:52,109 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:44:52,111 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437e6 type=client open_count=1 channel=[id: 0xe23ecc1f, 0.0.0.0/0.0.0.0:34108] timeout=300.0>) 2021-11-22 05:44:55,117 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:44:55,125 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:44:55,125 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437e7 type=client open_count=1 channel=[id: 0x36ac9ef4, 0.0.0.0/0.0.0.0:59277] timeout=300.0>) 2021-11-22 05:46:07,578 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:46:07,585 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:46:07,585 | infra | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437e8 type=client open_count=1 channel=[id: 0x843b7a7c, 0.0.0.0/0.0.0.0:57188] timeout=300.0>) 2021-11-22 05:46:25,407 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:46:25,415 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:46:25,415 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437e9 type=client open_count=1 channel=[id: 0x1e8bb4bd, 0.0.0.0/0.0.0.0:54230] timeout=300.0>) 2021-11-22 05:48:44,141 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:48:44,151 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:48:44,151 | infra | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:49:58,130 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:49:58,131 | infra | INFO | pool-3-thread-20 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:49:58,131 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637588680.12' completed 2021-11-22 05:51:10,591 | infra | ERROR | pool-3-thread-19 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:51:10,592 | infra | INFO | pool-3-thread-19 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:51:10,592 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637588680.07' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ea type=client open_count=1 channel=[id: 0x07ae9f07, 0.0.0.0/0.0.0.0:48338] timeout=300.0>) 2021-11-22 05:51:53,628 | infra | ERROR | pool-3-thread-6 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:51:53,628 | infra | INFO | pool-3-thread-6 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:51:53,630 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 900000started1637588680.03' completed 2021-11-22 05:51:53,630 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 950000started1637588680.07 2021-11-22 05:51:53,631 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1000000started1637588680.12 2021-11-22 05:51:53,631 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:51:53,631 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000 2021-11-22 05:51:53,631 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1050000 2021-11-22 05:51:53,667 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637589113.63 2021-11-22 05:51:53,667 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637589113.63' started 2021-11-22 05:51:53,667 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:51:53,667 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000 2021-11-22 05:51:53,667 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1100000 2021-11-22 05:51:53,703 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437eb type=client open_count=1 channel=[id: 0xd0faf5ea, 0.0.0.0/0.0.0.0:47574] timeout=300.0>) 2021-11-22 05:51:53,709 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:51:53,717 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:51:53,717 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:51:53,851 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637589113.67 2021-11-22 05:51:53,852 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637589113.67' started 2021-11-22 05:51:53,852 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:51:53,854 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000 2021-11-22 05:51:53,854 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1150000 2021-11-22 05:51:53,894 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 05:51:53,898 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637589113.85 2021-11-22 05:51:53,900 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637589113.85' started 2021-11-22 05:51:53,900 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:51:53,901 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:51:53,901 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637589113.63 2021-11-22 05:51:53,937 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437ec type=client open_count=1 channel=[id: 0x771bdaad, 0.0.0.0/0.0.0.0:55201] timeout=300.0>) 2021-11-22 05:53:02,346 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:53:02,355 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:53:02,355 | infra | DEBUG | pool-3-thread-24 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ed type=client open_count=1 channel=[id: 0xefb0f52a, 0.0.0.0/0.0.0.0:53409] timeout=300.0>) 2021-11-22 05:53:47,346 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:53:47,354 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:53:47,354 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ee type=client open_count=1 channel=[id: 0x2186f08a, 0.0.0.0/0.0.0.0:53558] timeout=300.0>) 2021-11-22 05:56:46,368 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:56:46,377 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:56:46,378 | infra | DEBUG | pool-3-thread-30 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:56:53,941 | infra | ERROR | pool-3-thread-1 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 05:56:53,943 | infra | INFO | pool-3-thread-1 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 05:56:53,943 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637589113.85' completed 2021-11-22 05:58:05,361 | infra | ERROR | pool-3-thread-24 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 05:58:05,362 | infra | INFO | pool-3-thread-24 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 05:58:05,362 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637589113.67' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ef type=client open_count=1 channel=[id: 0x676a5522, 0.0.0.0/0.0.0.0:36267] timeout=300.0>) 2021-11-22 05:59:47,134 | infra | ERROR | pool-3-thread-30 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:59:47,137 | infra | INFO | pool-3-thread-30 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 05:59:47,138 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1050000started1637589113.63' completed 2021-11-22 05:59:47,138 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1100000started1637589113.67 2021-11-22 05:59:47,138 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1150000started1637589113.85 2021-11-22 05:59:47,140 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 05:59:47,140 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000 2021-11-22 05:59:47,141 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1200000 2021-11-22 05:59:47,194 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637589587.14 2021-11-22 05:59:47,194 | infra | INFO | pool-3-thread-25 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637589587.14' started 2021-11-22 05:59:47,194 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:59:47,194 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000 2021-11-22 05:59:47,194 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1250000 2021-11-22 05:59:47,232 | infra | INFO | pool-3-thread-25 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f0 type=client open_count=1 channel=[id: 0x786d6dee, 0.0.0.0/0.0.0.0:45156] timeout=300.0>) 2021-11-22 05:59:47,236 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 05:59:47,243 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 05:59:47,244 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 05:59:47,246 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637589587.2 2021-11-22 05:59:47,246 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637589587.2' started 2021-11-22 05:59:47,246 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:59:47,247 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000 2021-11-22 05:59:47,247 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1300000 2021-11-22 05:59:47,282 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637589587.25 2021-11-22 05:59:47,282 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637589587.25' started 2021-11-22 05:59:47,282 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 05:59:47,282 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 05:59:47,282 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637589587.14 2021-11-22 05:59:47,290 | infra | INFO | pool-3-thread-28 | [task:call:6525] starting call 2021-11-22 05:59:47,319 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437f1 type=client open_count=1 channel=[id: 0x1412e0c5, 0.0.0.0/0.0.0.0:45582] timeout=300.0>) 2021-11-22 06:01:17,736 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:01:17,744 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:01:17,746 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f2 type=client open_count=1 channel=[id: 0x8b2d8f4f, 0.0.0.0/0.0.0.0:59330] timeout=300.0>) 2021-11-22 06:01:18,483 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:01:18,492 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:01:18,492 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f3 type=client open_count=1 channel=[id: 0x8d3f4176, 0.0.0.0/0.0.0.0:57948] timeout=300.0>) 2021-11-22 06:03:46,551 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:03:46,559 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:03:46,561 | infra | DEBUG | pool-3-thread-25 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:04:47,325 | infra | ERROR | pool-3-thread-23 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 06:04:47,325 | infra | INFO | pool-3-thread-23 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 06:04:47,325 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637589587.25' completed 2021-11-22 06:06:20,750 | infra | ERROR | pool-3-thread-28 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 06:06:20,752 | infra | INFO | pool-3-thread-28 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 06:06:20,753 | infra | INFO | pool-3-thread-28 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637589587.2' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f4 type=client open_count=1 channel=[id: 0xb02ee319, 0.0.0.0/0.0.0.0:44740] timeout=300.0>) 2021-11-22 06:07:35,651 | infra | ERROR | pool-3-thread-25 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:07:35,651 | infra | INFO | pool-3-thread-25 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:07:35,653 | infra | INFO | pool-3-thread-25 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1200000started1637589587.14' completed 2021-11-22 06:07:35,654 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1250000started1637589587.2 2021-11-22 06:07:35,654 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1300000started1637589587.25 2021-11-22 06:07:35,654 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:07:35,654 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000 2021-11-22 06:07:35,655 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1350000 2021-11-22 06:07:35,691 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637590055.66 2021-11-22 06:07:35,691 | infra | INFO | pool-3-thread-14 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637590055.66' started 2021-11-22 06:07:35,691 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:07:35,693 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000 2021-11-22 06:07:35,693 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1400000 2021-11-22 06:07:35,740 | infra | INFO | pool-3-thread-14 | [task:call:6525] starting call 2021-11-22 06:07:35,742 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637590055.69 2021-11-22 06:07:35,742 | infra | INFO | pool-3-thread-27 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637590055.69' started 2021-11-22 06:07:35,742 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:07:35,743 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000 2021-11-22 06:07:35,743 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1450000 Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f5 type=client open_count=1 channel=[id: 0x4be16f33, 0.0.0.0/0.0.0.0:42391] timeout=300.0>) 2021-11-22 06:07:35,747 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:07:35,756 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:07:35,756 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:07:35,782 | infra | INFO | pool-3-thread-27 | [task:call:6525] starting call 2021-11-22 06:07:35,934 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637590055.74 2021-11-22 06:07:35,934 | infra | INFO | pool-3-thread-5 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637590055.74' started 2021-11-22 06:07:35,934 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:07:35,936 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 06:07:35,936 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637590055.66 2021-11-22 06:07:36,006 | infra | INFO | pool-3-thread-5 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437f6 type=client open_count=1 channel=[id: 0x7b4d7381, 0.0.0.0/0.0.0.0:39599] timeout=300.0>) 2021-11-22 06:08:05,884 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:08:05,892 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:08:05,894 | infra | DEBUG | pool-3-thread-5 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f7 type=client open_count=1 channel=[id: 0x52feab3a, 0.0.0.0/0.0.0.0:57387] timeout=300.0>) 2021-11-22 06:09:36,947 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:09:36,956 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:09:36,957 | infra | DEBUG | pool-3-thread-14 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:09:43,318 | infra | ERROR | pool-3-thread-27 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection0%60+data+USE+INDEX+%28default_Scope1_FunctionCollection0_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1400000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "1bc8d75a-94e8-4727-bc08-f1b2b8dac3ad", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m7.42748995s","executionTime": "2m7.419541716s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"sortCount": 92378,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:09:43,319 | infra | DEBUG | pool-3-thread-27 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:09:43,321 | infra | DEBUG | pool-3-thread-27 | [task:call:6532] Status of the query 0 2021-11-22 06:09:43,322 | infra | INFO | pool-3-thread-27 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:09:43,322 | infra | INFO | pool-3-thread-27 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637590055.69' completed 2021-11-22 06:13:08,898 | infra | ERROR | pool-3-thread-5 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 06:13:08,901 | infra | INFO | pool-3-thread-5 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 06:13:08,901 | infra | INFO | pool-3-thread-5 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637590055.74' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f8 type=client open_count=1 channel=[id: 0x81f1edaf, 0.0.0.0/0.0.0.0:48985] timeout=300.0>) 2021-11-22 06:13:09,233 | infra | ERROR | pool-3-thread-14 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:13:09,234 | infra | INFO | pool-3-thread-14 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:13:09,236 | infra | INFO | pool-3-thread-14 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1350000started1637590055.66' completed 2021-11-22 06:13:09,236 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1400000started1637590055.69 2021-11-22 06:13:09,236 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1450000started1637590055.74 2021-11-22 06:13:09,236 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:13:09,237 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000 2021-11-22 06:13:09,237 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1500000 2021-11-22 06:13:09,292 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637590389.24 2021-11-22 06:13:09,292 | infra | INFO | pool-3-thread-2 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637590389.24' started 2021-11-22 06:13:09,292 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:13:09,292 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000 2021-11-22 06:13:09,292 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1550000 2021-11-22 06:13:09,332 | infra | INFO | pool-3-thread-2 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437f9 type=client open_count=1 channel=[id: 0x9a996b1d, 0.0.0.0/0.0.0.0:37230] timeout=300.0>) 2021-11-22 06:13:09,336 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637590389.29 2021-11-22 06:13:09,336 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:13:09,336 | infra | INFO | pool-3-thread-9 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637590389.29' started 2021-11-22 06:13:09,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:13:09,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000 2021-11-22 06:13:09,338 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1600000 2021-11-22 06:13:09,345 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:13:09,345 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:13:09,384 | infra | INFO | pool-3-thread-9 | [task:call:6525] starting call 2021-11-22 06:13:09,418 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637590389.34 2021-11-22 06:13:09,418 | infra | INFO | pool-3-thread-12 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637590389.34' started 2021-11-22 06:13:09,420 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:13:09,420 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 06:13:09,421 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637590389.24 2021-11-22 06:13:09,459 | infra | INFO | pool-3-thread-12 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x18437fa type=client open_count=1 channel=[id: 0x4a7947c3, 0.0.0.0/0.0.0.0:57078] timeout=300.0>) 2021-11-22 06:13:51,173 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:13:51,180 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:13:51,180 | infra | DEBUG | pool-3-thread-9 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x18437fb type=client open_count=1 channel=[id: 0xcadeec7e, 0.0.0.0/0.0.0.0:47267] timeout=300.0>) 2021-11-22 06:14:19,510 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:14:19,520 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:14:19,520 | infra | DEBUG | pool-3-thread-12 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437fc type=client open_count=1 channel=[id: 0x1b5201a2, 0.0.0.0/0.0.0.0:54422] timeout=300.0>) 2021-11-22 06:15:12,908 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:15:12,915 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:15:12,917 | infra | DEBUG | pool-3-thread-2 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:18:54,187 | infra | ERROR | pool-3-thread-9 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 06:18:54,187 | infra | INFO | pool-3-thread-9 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 06:18:54,187 | infra | INFO | pool-3-thread-9 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637590389.29' completed 2021-11-22 06:19:22,526 | infra | ERROR | pool-3-thread-12 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 06:19:22,526 | infra | INFO | pool-3-thread-12 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 06:19:22,528 | infra | INFO | pool-3-thread-12 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637590389.34' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437fd type=client open_count=1 channel=[id: 0x5934199a, 0.0.0.0/0.0.0.0:33527] timeout=300.0>) 2021-11-22 06:19:49,467 | infra | ERROR | pool-3-thread-2 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:19:49,467 | infra | INFO | pool-3-thread-2 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:19:49,467 | infra | INFO | pool-3-thread-2 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1500000started1637590389.24' completed 2021-11-22 06:19:49,469 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1550000started1637590389.29 2021-11-22 06:19:49,470 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1600000started1637590389.34 2021-11-22 06:19:49,470 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:19:49,470 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000 2021-11-22 06:19:49,470 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1650000 2021-11-22 06:19:49,516 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637590789.47 2021-11-22 06:19:49,516 | infra | INFO | pool-3-thread-11 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637590789.47' started 2021-11-22 06:19:49,516 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:19:49,517 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000 2021-11-22 06:19:49,519 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1700000 2021-11-22 06:19:49,555 | infra | INFO | pool-3-thread-11 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437fe type=client open_count=1 channel=[id: 0x09221ffa, 0.0.0.0/0.0.0.0:43163] timeout=300.0>) 2021-11-22 06:19:49,562 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:19:49,569 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:19:49,571 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:19:49,744 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637590789.52 2021-11-22 06:19:49,744 | infra | INFO | pool-3-thread-26 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637590789.52' started 2021-11-22 06:19:49,744 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:19:49,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000 2021-11-22 06:19:49,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1750000 2021-11-22 06:19:49,792 | infra | INFO | pool-3-thread-26 | [task:call:6525] starting call 2021-11-22 06:19:49,799 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637590789.75 2021-11-22 06:19:49,799 | infra | INFO | pool-3-thread-17 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637590789.75' started 2021-11-22 06:19:49,801 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:19:49,802 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 06:19:49,802 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637590789.47 2021-11-22 06:19:49,854 | infra | INFO | pool-3-thread-17 | [task:call:6525] starting call 2021-11-22 06:21:16,608 | infra | INFO | pool-3-thread-26 | [task:call:6536] Got exception:'' with index name None 2021-11-22 06:21:16,608 | infra | INFO | pool-3-thread-26 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637590789.52' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x18437ff type=client open_count=1 channel=[id: 0xdd5e8e82, 0.0.0.0/0.0.0.0:55975] timeout=300.0>) 2021-11-22 06:21:22,780 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:21:22,789 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:21:22,789 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:21:54,404 | infra | ERROR | pool-3-thread-17 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=select+%2A+from+%60default%60.%60Scope1%60.%60FunctionCollection0%60+data+USE+INDEX+%28default_Scope1_FunctionCollection0_1+USING+GSI%29+where+body+is+not+missing+order+by+meta%28%29.id+limit+50000+offset+1750000 headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "575b46f9-f56f-4bf0-a73a-fa1842c2dd7b", "signature": {"*":"*"}, "results": [ ], "errors": [{"code":5000,"msg":" Index scan timed out - cause: Index scan timed out"}], "status": "errors", "metrics": {"elapsedTime": "2m4.378711688s","executionTime": "2m4.378305189s","resultCount": 0,"resultSize": 0,"serviceLoad": 1,"sortCount": 514998,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:21:54,407 | infra | DEBUG | pool-3-thread-17 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:21:54,407 | infra | DEBUG | pool-3-thread-17 | [task:call:6532] Status of the query 0 2021-11-22 06:21:54,408 | infra | INFO | pool-3-thread-17 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:21:54,408 | infra | INFO | pool-3-thread-17 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637590789.75' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843800 type=client open_count=1 channel=[id: 0x0d9db6c2, 0.0.0.0/0.0.0.0:33874] timeout=300.0>) 2021-11-22 06:23:22,016 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:23:22,023 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:23:22,023 | infra | DEBUG | pool-3-thread-11 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843801 type=client open_count=1 channel=[id: 0x694cc888, 0.0.0.0/0.0.0.0:33300] timeout=300.0>) 2021-11-22 06:24:53,658 | infra | ERROR | pool-3-thread-11 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:24:53,660 | infra | INFO | pool-3-thread-11 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:24:53,660 | infra | INFO | pool-3-thread-11 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1650000started1637590789.47' completed 2021-11-22 06:24:53,661 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1700000started1637590789.52 2021-11-22 06:24:53,661 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1750000started1637590789.75 2021-11-22 06:24:53,661 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:24:53,663 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000 2021-11-22 06:24:53,663 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1800000 2021-11-22 06:24:53,700 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637591093.66 2021-11-22 06:24:53,700 | infra | INFO | pool-3-thread-3 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637591093.66' started 2021-11-22 06:24:53,700 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:24:53,701 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000 2021-11-22 06:24:53,701 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1850000 2021-11-22 06:24:53,744 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637591093.7 2021-11-22 06:24:53,746 | infra | INFO | pool-3-thread-22 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637591093.7' started 2021-11-22 06:24:53,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:24:53,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000 2021-11-22 06:24:53,746 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1900000 2021-11-22 06:24:53,765 | infra | INFO | pool-3-thread-3 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843802 type=client open_count=1 channel=[id: 0x9595f647, 0.0.0.0/0.0.0.0:60480] timeout=300.0>) 2021-11-22 06:24:53,772 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:24:53,785 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:24:53,786 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:24:53,799 | infra | INFO | pool-3-thread-22 | [task:call:6525] starting call 2021-11-22 06:24:53,815 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637591093.75 2021-11-22 06:24:53,815 | infra | INFO | pool-3-thread-8 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637591093.75' started 2021-11-22 06:24:53,815 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:24:53,815 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 06:24:53,816 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637591093.66 2021-11-22 06:24:53,855 | infra | INFO | pool-3-thread-8 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843803 type=client open_count=1 channel=[id: 0x95289581, 0.0.0.0/0.0.0.0:37637] timeout=300.0>) 2021-11-22 06:26:03,497 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:26:03,505 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:26:03,505 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843804 type=client open_count=1 channel=[id: 0x7001252b, 0.0.0.0/0.0.0.0:59941] timeout=300.0>) 2021-11-22 06:27:53,184 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:27:53,190 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:27:53,191 | infra | DEBUG | pool-3-thread-3 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:29:53,805 | infra | ERROR | pool-3-thread-22 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 06:29:53,806 | infra | INFO | pool-3-thread-22 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 06:29:53,806 | infra | INFO | pool-3-thread-22 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637591093.7' completed 2021-11-22 06:29:53,861 | infra | ERROR | pool-3-thread-8 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 06:29:53,861 | infra | INFO | pool-3-thread-8 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 06:29:53,862 | infra | INFO | pool-3-thread-8 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637591093.75' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843805 type=client open_count=1 channel=[id: 0x4725562d, 0.0.0.0/0.0.0.0:43365] timeout=300.0>) 2021-11-22 06:30:56,342 | infra | ERROR | pool-3-thread-3 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:30:56,342 | infra | INFO | pool-3-thread-3 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:30:56,342 | infra | INFO | pool-3-thread-3 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1800000started1637591093.66' completed 2021-11-22 06:30:56,344 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1850000started1637591093.7 2021-11-22 06:30:56,344 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1900000started1637591093.75 2021-11-22 06:30:56,345 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:30:56,345 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000 2021-11-22 06:30:56,345 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 1950000 2021-11-22 06:30:56,378 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637591456.35 2021-11-22 06:30:56,378 | infra | INFO | pool-3-thread-10 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637591456.35' started 2021-11-22 06:30:56,380 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:30:56,381 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000 2021-11-22 06:30:56,381 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2000000 2021-11-22 06:30:56,417 | infra | INFO | pool-3-thread-10 | [task:call:6525] starting call 2021-11-22 06:30:56,417 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637591456.38 2021-11-22 06:30:56,418 | infra | INFO | pool-3-thread-18 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637591456.38' started 2021-11-22 06:30:56,418 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:30:56,418 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000 2021-11-22 06:30:56,420 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2050000 Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843806 type=client open_count=1 channel=[id: 0x7c3c12f1, 0.0.0.0/0.0.0.0:60733] timeout=300.0>) 2021-11-22 06:30:56,424 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:30:56,433 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:30:56,433 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:30:56,454 | infra | INFO | pool-3-thread-18 | [task:call:6525] starting call 2021-11-22 06:30:56,552 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637591456.42 2021-11-22 06:30:56,552 | infra | INFO | pool-3-thread-13 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637591456.42' started 2021-11-22 06:30:56,552 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:30:56,553 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:252] Getting status for each query 2021-11-22 06:30:56,553 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637591456.35 2021-11-22 06:30:56,604 | infra | INFO | pool-3-thread-13 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.208:8093 during connect (<_realsocket at 0x1843807 type=client open_count=1 channel=[id: 0x92f0f62a, 0.0.0.0/0.0.0.0:60044] timeout=300.0>) 2021-11-22 06:31:29,184 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:31:29,193 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:31:29,193 | infra | DEBUG | pool-3-thread-13 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.220:8093 during connect (<_realsocket at 0x1843808 type=client open_count=1 channel=[id: 0xa5857264, 0.0.0.0/0.0.0.0:53540] timeout=300.0>) 2021-11-22 06:32:36,647 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:32:36,654 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:32:36,654 | infra | DEBUG | pool-3-thread-18 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843809 type=client open_count=1 channel=[id: 0xf2899c15, 0.0.0.0/0.0.0.0:38872] timeout=300.0>) 2021-11-22 06:32:44,349 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:32:44,357 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:32:44,358 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380a type=client open_count=1 channel=[id: 0x77587a94, 0.0.0.0/0.0.0.0:52549] timeout=300.0>) 2021-11-22 06:34:49,865 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:34:49,874 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:34:49,875 | infra | DEBUG | pool-3-thread-10 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:36:32,197 | infra | ERROR | pool-3-thread-13 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.208:8093/query/service. Error timed out 2021-11-22 06:36:32,198 | infra | INFO | pool-3-thread-13 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.208 with index name None 2021-11-22 06:36:32,198 | infra | INFO | pool-3-thread-13 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637591456.42' completed 2021-11-22 06:37:39,658 | infra | ERROR | pool-3-thread-18 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.220:8093/query/service. Error timed out 2021-11-22 06:37:39,660 | infra | INFO | pool-3-thread-18 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.220 with index name None 2021-11-22 06:37:39,661 | infra | INFO | pool-3-thread-18 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637591456.38' completed Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380b type=client open_count=1 channel=[id: 0x3e4ddb83, 0.0.0.0/0.0.0.0:40297] timeout=300.0>) 2021-11-22 06:38:54,170 | infra | ERROR | pool-3-thread-10 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:38:54,171 | infra | INFO | pool-3-thread-10 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:38:54,171 | infra | INFO | pool-3-thread-10 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 1950000started1637591456.35' completed 2021-11-22 06:38:54,171 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2000000started1637591456.38 2021-11-22 06:38:54,173 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2050000started1637591456.42 2021-11-22 06:38:54,173 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:255] Resetting the list 2021-11-22 06:38:54,174 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:244] Query is select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000 2021-11-22 06:38:54,174 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:245] Offset is 2100000 2021-11-22 06:38:54,213 | infra | INFO | pool-3-thread-16 | [task:start_task:89] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637591934.17' started 2021-11-22 06:38:54,213 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637591934.17 2021-11-22 06:38:54,214 | test | DEBUG | MainThread | [index_ready_functions:run_full_scan:250] Is sync is true 2021-11-22 06:38:54,250 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`FunctionCollection1`.`default__default_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.22 2021-11-22 06:38:54,250 | infra | INFO | pool-3-thread-4 | [task:start_task:89] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`FunctionCollection1`.`default__default_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.22' started 2021-11-22 06:38:54,256 | infra | INFO | pool-3-thread-16 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380c type=client open_count=1 channel=[id: 0x060f0cea, 0.0.0.0/0.0.0.0:56678] timeout=300.0>) 2021-11-22 06:38:54,259 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:38:54,267 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:38:54,269 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:38:54,289 | infra | INFO | pool-3-thread-4 | [task:call:6525] starting call 2021-11-22 06:38:54,292 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`_default`.`default__default__default_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.25 2021-11-22 06:38:54,292 | infra | INFO | pool-3-thread-15 | [task:start_task:89] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`_default`.`default__default__default_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.25' started Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380d type=client open_count=1 channel=[id: 0xdb50939b, 0.0.0.0/0.0.0.0:38296] timeout=300.0>) 2021-11-22 06:38:54,295 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:38:54,302 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:38:54,303 | infra | DEBUG | pool-3-thread-4 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:38:54,329 | infra | INFO | pool-3-thread-15 | [task:call:6525] starting call 2021-11-22 06:38:54,417 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection1`.`default_Scope1_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.29 2021-11-22 06:38:54,417 | infra | INFO | pool-3-thread-29 | [task:start_task:89] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection1`.`default_Scope1_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.29' started 2021-11-22 06:38:54,453 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection0`.`default_Scope1_FunctionCollection0_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.42 2021-11-22 06:38:54,453 | infra | INFO | pool-3-thread-7 | [task:start_task:89] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection0`.`default_Scope1_FunctionCollection0_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.42' started 2021-11-22 06:38:54,453 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`FunctionCollection1`.`default__default_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.22 2021-11-22 06:38:54,457 | infra | INFO | pool-3-thread-29 | [task:call:6525] starting call 2021-11-22 06:38:54,489 | infra | INFO | pool-3-thread-7 | [task:call:6525] starting call Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380e type=client open_count=1 channel=[id: 0x9696b495, 0.0.0.0/0.0.0.0:57881] timeout=300.0>) 2021-11-22 06:38:54,493 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:38:54,500 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:38:54,500 | infra | DEBUG | pool-3-thread-7 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:38:54,655 | infra | ERROR | pool-3-thread-15 | [Rest_Connection:_http_request:283] POST http://172.23.105.220:8093/query/service body: scan_consistency=request_plus&statement=ALTER+INDEX+default%3A%60default%60.%60_default%60.%60_default%60.%60default__default__default_1%60+WITH+%7B%22action%22%3A+%22replica_count%22%2C+%22num_replica%22%3A+2%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "95bc6332-3495-424d-941a-4a75363a464b", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI AlterIndex() - cause: Fail to alter index: Fails to create index. There are not enough indexer nodes to create index with replica count of 2. Some indexer nodes may be marked as excluded."}], "status": "errors", "metrics": {"elapsedTime": "272.761416ms","executionTime": "238.215145ms","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:38:54,657 | infra | DEBUG | pool-3-thread-15 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:38:54,658 | infra | DEBUG | pool-3-thread-15 | [task:call:6532] Status of the query 0 2021-11-22 06:38:54,658 | infra | INFO | pool-3-thread-15 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:38:54,660 | infra | INFO | pool-3-thread-15 | [task:complete_task:104] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`_default`.`default__default__default_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.25' completed 2021-11-22 06:38:56,308 | infra | ERROR | pool-3-thread-29 | [Rest_Connection:_http_request:283] POST http://172.23.105.208:8093/query/service body: scan_consistency=request_plus&statement=ALTER+INDEX+default%3A%60default%60.%60Scope1%60.%60FunctionCollection1%60.%60default_Scope1_FunctionCollection1_1%60+WITH+%7B%22action%22%3A+%22replica_count%22%2C+%22num_replica%22%3A+2%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "1f2643fe-2eb9-4599-8d00-60fc5bfa5b6f", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI AlterIndex() - cause: Fail to alter index: Fails to create index. There are not enough indexer nodes to create index with replica count of 2. Some indexer nodes may be marked as excluded."}], "status": "errors", "metrics": {"elapsedTime": "1.761787767s","executionTime": "1.72762446s","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:38:56,309 | infra | DEBUG | pool-3-thread-29 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:38:56,311 | infra | DEBUG | pool-3-thread-29 | [task:call:6532] Status of the query 0 2021-11-22 06:38:56,311 | infra | INFO | pool-3-thread-29 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:38:56,311 | infra | INFO | pool-3-thread-29 | [task:complete_task:104] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection1`.`default_Scope1_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.29' completed 2021-11-22 06:38:58,052 | infra | ERROR | pool-3-thread-4 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=ALTER+INDEX+default%3A%60default%60.%60_default%60.%60FunctionCollection1%60.%60default__default_FunctionCollection1_1%60+WITH+%7B%22action%22%3A+%22replica_count%22%2C+%22num_replica%22%3A+2%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "74065d1e-340e-4f1c-b895-c716b4767c4d", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI AlterIndex() - cause: Fail to alter index: Fails to create index. There are not enough indexer nodes to create index with replica count of 2. Some indexer nodes may be marked as excluded."}], "status": "errors", "metrics": {"elapsedTime": "733.296863ms","executionTime": "733.132816ms","resultCount": 0,"resultSize": 0,"serviceLoad": 4,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:38:58,055 | infra | DEBUG | pool-3-thread-4 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:38:58,055 | infra | DEBUG | pool-3-thread-4 | [task:call:6532] Status of the query 0 2021-11-22 06:38:58,055 | infra | INFO | pool-3-thread-4 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:38:58,056 | infra | INFO | pool-3-thread-4 | [task:complete_task:104] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`FunctionCollection1`.`default__default_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.22' completed 2021-11-22 06:38:58,058 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_ALTER INDEX default:`default`.`_default`.`_default`.`default__default__default_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.25 2021-11-22 06:38:58,058 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection1`.`default_Scope1_FunctionCollection1_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.29 2021-11-22 06:38:58,059 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection0`.`default_Scope1_FunctionCollection0_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.42 2021-11-22 06:38:58,081 | infra | ERROR | pool-3-thread-7 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query/service body: scan_consistency=request_plus&statement=ALTER+INDEX+default%3A%60default%60.%60Scope1%60.%60FunctionCollection0%60.%60default_Scope1_FunctionCollection0_1%60+WITH+%7B%22action%22%3A+%22replica_count%22%2C+%22num_replica%22%3A+2%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "491f0385-62e4-4123-85ab-53f4b075a088", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI AlterIndex() - cause: Fail to alter index: Fails to create index. There are not enough indexer nodes to create index with replica count of 2. Some indexer nodes may be marked as excluded."}], "status": "errors", "metrics": {"elapsedTime": "564.536155ms","executionTime": "564.133188ms","resultCount": 0,"resultSize": 0,"serviceLoad": 3,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:38:58,082 | infra | DEBUG | pool-3-thread-7 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:38:58,082 | infra | DEBUG | pool-3-thread-7 | [task:call:6532] Status of the query 0 2021-11-22 06:38:58,084 | infra | INFO | pool-3-thread-7 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:38:58,084 | infra | INFO | pool-3-thread-7 | [task:complete_task:104] Thread 'ExecuteQueriesTask_ALTER INDEX default:`default`.`Scope1`.`FunctionCollection0`.`default_Scope1_FunctionCollection0_1` WITH {"action": "replica_count", "num_replica": 2}started1637591934.42' completed 2021-11-22 06:38:58,085 | test | INFO | MainThread | [plasma_stats:test_system_stability_with_indexer:688] Creating index from last 2 buckets started 2021-11-22 06:38:58,085 | test | INFO | MainThread | [index_ready_functions:create_gsi_on_each_collection:59] Creating indexes with defer:0 build 2021-11-22 06:38:58,085 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default_FunctionCollection1_2` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 } 2021-11-22 06:38:58,085 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default_FunctionCollection1_2 2021-11-22 06:38:58,121 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_2` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637591938.09 2021-11-22 06:38:58,121 | infra | INFO | pool-3-thread-21 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_2` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637591938.09' started 2021-11-22 06:38:58,122 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_2` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637591938.09 2021-11-22 06:38:58,157 | infra | INFO | pool-3-thread-21 | [task:call:6525] starting call 2021-11-22 06:38:58,157 | infra | DEBUG | pool-3-thread-21 | [GsiHelper_Rest:execute_query:419] Query params: statement=CREATE+INDEX+%60default__default_FunctionCollection1_2%60+ON+%60default%60.%60_default%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x184380f type=client open_count=1 channel=[id: 0xe3c2ed29, 0.0.0.0/0.0.0.0:58981] timeout=300.0>) 2021-11-22 06:42:29,950 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:42:29,959 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:42:29,959 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843810 type=client open_count=1 channel=[id: 0x33b3b868, 0.0.0.0/0.0.0.0:51127] timeout=300.0>) 2021-11-22 06:42:29,969 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query. Error [Errno 111] Connection refused 2021-11-22 06:42:29,976 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:42:29,976 | infra | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:42:35,401 | infra | ERROR | pool-3-thread-21 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query body: statement=CREATE+INDEX+%60default__default_FunctionCollection1_2%60+ON+%60default%60.%60_default%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "96251f7b-55b8-41c4-b07c-a871fd250a15", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index default__default_FunctionCollection1_2 already exists."}], "status": "errors", "metrics": {"elapsedTime": "2.40971885s","executionTime": "2.409618392s","resultCount": 0,"resultSize": 0,"serviceLoad": 7,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:42:35,403 | infra | DEBUG | pool-3-thread-21 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:42:35,404 | infra | DEBUG | pool-3-thread-21 | [task:call:6532] Status of the query 0 2021-11-22 06:42:35,404 | infra | INFO | pool-3-thread-21 | [task:call:6534] check isIndexQuery statusTrue 2021-11-22 06:42:35,404 | infra | INFO | pool-3-thread-21 | [task:call:6540] Waiting for polling status:default__default_FunctionCollection1_2 2021-11-22 06:42:35,404 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default_FunctionCollection1_2 2021-11-22 06:42:35,456 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:35,456 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:36,457 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 0 2021-11-22 06:42:36,505 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:36,506 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:37,506 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 1 2021-11-22 06:42:37,546 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:37,546 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:38,546 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 2 2021-11-22 06:42:38,588 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:38,588 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:39,588 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 3 2021-11-22 06:42:39,634 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:39,634 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:40,634 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 4 2021-11-22 06:42:40,674 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:40,674 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:41,674 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 5 2021-11-22 06:42:41,719 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:41,720 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:42,720 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 6 2021-11-22 06:42:42,769 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:42,769 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:43,769 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 7 2021-11-22 06:42:43,811 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:43,812 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:44,812 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 8 2021-11-22 06:42:44,852 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:44,854 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:45,855 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 9 2021-11-22 06:42:45,892 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:45,894 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:46,894 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 10 2021-11-22 06:42:46,934 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:46,934 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:47,936 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 11 2021-11-22 06:42:47,973 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:47,974 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:48,976 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 12 2021-11-22 06:42:49,020 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:49,022 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:50,022 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 13 2021-11-22 06:42:50,062 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:50,062 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:51,062 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 14 2021-11-22 06:42:51,102 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:51,102 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:52,104 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 15 2021-11-22 06:42:52,154 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:52,154 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:53,155 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 16 2021-11-22 06:42:53,236 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:53,236 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:54,236 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 17 2021-11-22 06:42:54,285 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:54,286 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:55,286 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 18 2021-11-22 06:42:55,328 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:55,329 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:56,329 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 19 2021-11-22 06:42:56,372 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:56,372 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:57,374 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 20 2021-11-22 06:42:57,418 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:57,418 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:58,420 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 21 2021-11-22 06:42:58,463 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:58,464 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:42:59,466 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 22 2021-11-22 06:42:59,513 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:42:59,513 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:00,515 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 23 2021-11-22 06:43:00,563 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:00,565 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:01,565 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 24 2021-11-22 06:43:01,609 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:01,609 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:02,611 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 25 2021-11-22 06:43:02,657 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:02,658 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:03,660 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 26 2021-11-22 06:43:03,716 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:03,717 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:04,717 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 27 2021-11-22 06:43:04,770 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:04,772 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:05,773 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 28 2021-11-22 06:43:05,828 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:05,829 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:06,831 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 29 2021-11-22 06:43:06,878 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:06,878 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:07,880 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 30 2021-11-22 06:43:07,927 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:07,928 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:08,930 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 31 2021-11-22 06:43:08,977 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:08,979 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:09,980 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 32 2021-11-22 06:43:10,026 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:10,026 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:11,028 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 33 2021-11-22 06:43:11,088 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:11,088 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:12,088 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 34 2021-11-22 06:43:12,150 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:12,151 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:13,151 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 35 2021-11-22 06:43:13,194 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:13,194 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:14,196 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 36 2021-11-22 06:43:14,250 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:14,250 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:15,250 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 37 2021-11-22 06:43:15,289 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:15,289 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:16,290 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 38 2021-11-22 06:43:16,348 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:16,349 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:17,349 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 39 2021-11-22 06:43:17,404 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:17,405 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:18,407 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 40 2021-11-22 06:43:18,448 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:18,450 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:19,450 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 41 2021-11-22 06:43:19,502 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:19,503 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:20,503 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 42 2021-11-22 06:43:20,549 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:20,549 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:21,551 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 43 2021-11-22 06:43:21,596 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:21,598 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:22,598 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 44 2021-11-22 06:43:22,644 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:22,645 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:23,647 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 45 2021-11-22 06:43:23,701 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:23,703 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:24,703 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 46 2021-11-22 06:43:24,763 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:24,763 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:25,763 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 47 2021-11-22 06:43:26,286 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:26,286 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843811 type=client open_count=1 channel=[id: 0x4aa1149d, 0.0.0.0/0.0.0.0:34735] timeout=300.0>) 2021-11-22 06:43:26,961 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:43:26,970 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:43:26,970 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:43:27,286 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 48 2021-11-22 06:43:27,336 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:27,338 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:28,338 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 49 2021-11-22 06:43:28,378 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:28,380 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:29,381 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 50 2021-11-22 06:43:29,421 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:29,421 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:30,423 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 51 2021-11-22 06:43:30,470 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:30,470 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:31,471 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 52 2021-11-22 06:43:31,516 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:31,516 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:32,517 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 53 2021-11-22 06:43:32,562 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:32,562 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:33,563 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 54 2021-11-22 06:43:33,608 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:33,608 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:34,608 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 55 2021-11-22 06:43:34,657 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:34,657 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:35,657 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 56 2021-11-22 06:43:35,710 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:35,710 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:36,711 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 57 2021-11-22 06:43:36,760 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:36,760 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:37,762 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 58 2021-11-22 06:43:37,802 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:37,802 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:38,803 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 59 2021-11-22 06:43:38,848 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:38,848 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:39,848 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 60 2021-11-22 06:43:39,894 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:39,895 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:40,897 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 61 2021-11-22 06:43:40,937 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:40,937 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:41,937 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 62 2021-11-22 06:43:41,982 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:41,982 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:42,983 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 63 2021-11-22 06:43:43,026 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:43,026 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:44,026 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 64 2021-11-22 06:43:44,062 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:44,063 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:45,065 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 65 2021-11-22 06:43:45,107 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:45,108 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:46,108 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 66 2021-11-22 06:43:46,154 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:46,154 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:47,154 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 67 2021-11-22 06:43:47,194 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:47,194 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:48,196 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 68 2021-11-22 06:43:48,236 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:48,236 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:49,236 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 69 2021-11-22 06:43:49,283 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:49,283 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:50,285 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 70 2021-11-22 06:43:50,315 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:50,316 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:51,316 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 71 2021-11-22 06:43:51,355 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:51,357 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:52,357 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 72 2021-11-22 06:43:52,420 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:52,421 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843812 type=client open_count=1 channel=[id: 0x522b7df8, 0.0.0.0/0.0.0.0:32850] timeout=300.0>) 2021-11-22 06:43:52,783 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:43:52,790 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:43:52,792 | infra | DEBUG | pool-3-thread-16 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:43:53,421 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 73 2021-11-22 06:43:53,463 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:53,463 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:54,463 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 74 2021-11-22 06:43:54,509 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:54,509 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:55,509 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 75 2021-11-22 06:43:55,549 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:55,549 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:56,549 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 76 2021-11-22 06:43:56,588 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:56,588 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:57,589 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 77 2021-11-22 06:43:57,634 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:57,634 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:58,635 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 78 2021-11-22 06:43:58,681 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:58,681 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:43:59,683 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 79 2021-11-22 06:43:59,753 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:43:59,755 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:00,756 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 80 2021-11-22 06:44:00,792 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:00,793 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:01,793 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 81 2021-11-22 06:44:01,835 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:01,835 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:02,836 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 82 2021-11-22 06:44:02,877 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:02,877 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:03,878 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 83 2021-11-22 06:44:03,927 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:03,927 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:04,927 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 84 2021-11-22 06:44:04,969 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:04,969 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:05,970 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 85 2021-11-22 06:44:06,006 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:06,006 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:07,007 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 86 2021-11-22 06:44:07,053 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:07,053 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:08,055 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 87 2021-11-22 06:44:08,094 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:08,094 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:09,095 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 88 2021-11-22 06:44:09,138 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:09,140 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:10,140 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 89 2021-11-22 06:44:10,184 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:10,184 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:11,184 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 90 2021-11-22 06:44:11,223 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:11,224 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:12,226 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 91 2021-11-22 06:44:12,273 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:12,273 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:13,273 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 92 2021-11-22 06:44:13,315 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:13,315 | test | DEBUG | pool-3-thread-21 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:14,315 | infra | INFO | pool-3-thread-21 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default_FunctionCollection1_2 not found with iteration 93 2021-11-22 06:44:14,349 | infra | INFO | pool-3-thread-21 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default_FunctionCollection1_2` ON `default`.`_default`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637591938.09' completed 2021-11-22 06:44:14,351 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default__default__default_2` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': False, 'num_replica': 0 } 2021-11-22 06:44:14,351 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default__default__default_2 2021-11-22 06:44:14,401 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default__default__default_2` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592254.35 2021-11-22 06:44:14,401 | infra | INFO | pool-3-thread-20 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_2` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592254.35' started 2021-11-22 06:44:14,401 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default__default__default_2` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592254.35 2021-11-22 06:44:15,451 | infra | INFO | pool-3-thread-20 | [task:call:6525] starting call 2021-11-22 06:44:15,453 | infra | DEBUG | pool-3-thread-20 | [GsiHelper_Rest:execute_query:419] Query params: statement=CREATE+INDEX+%60default__default__default_2%60+ON+%60default%60.%60_default%60.%60_default%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843813 type=client open_count=1 channel=[id: 0x32b5e315, 0.0.0.0/0.0.0.0:34748] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.105.221:8093 during connect (<_realsocket at 0x1843814 type=client open_count=1 channel=[id: 0x5437f0e9, 0.0.0.0/0.0.0.0:57774] timeout=300.0>) 2021-11-22 06:44:38,239 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query. Error [Errno 111] Connection refused 2021-11-22 06:44:38,239 | infra | ERROR | pool-3-thread-16 | [Rest_Connection:_http_request:287] Socket error while connecting to http://172.23.105.221:8093/query/service. Error [Errno 111] Connection refused 2021-11-22 06:44:38,240 | infra | INFO | pool-3-thread-16 | [task:call:6536] Got exception:Unable to reach the host @ 172.23.105.221 with index name None 2021-11-22 06:44:38,240 | infra | INFO | pool-3-thread-16 | [task:complete_task:104] Thread 'ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637591934.17' completed 2021-11-22 06:44:38,246 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from connections/Rest_Connection.py -> _http_request():L296 2021-11-22 06:44:38,246 | infra | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 3 seconds. Reason: None 2021-11-22 06:44:41,513 | infra | ERROR | pool-3-thread-20 | [Rest_Connection:_http_request:283] POST http://172.23.105.221:8093/query body: statement=CREATE+INDEX+%60default__default__default_2%60+ON+%60default%60.%60_default%60.%60_default%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D headers: {'Accept': '*/*', 'Connection': 'keep-alive', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown { "requestID": "e67c9936-7aac-4c25-80e5-95d00fbb1a5a", "signature": null, "results": [ ], "errors": [{"code":5000,"msg":"GSI CreateIndex() - cause: Index default__default__default_2 already exists."}], "status": "errors", "metrics": {"elapsedTime": "249.250541ms","executionTime": "248.864439ms","resultCount": 0,"resultSize": 0,"serviceLoad": 6,"errorCount": 1} } auth: Administrator:password 2021-11-22 06:44:41,515 | infra | DEBUG | pool-3-thread-20 | [Rest_Connection:_http_request:284] File "lib/Jython_tasks/task.py", line 6528, in call status, content, header = indexer_rest.execute_query(server=self.server, query=self.query, File "lib/gsiLib/GsiHelper_Rest.py", line 424, in execute_query status, content, header = self._http_request(url, 'POST', params, File "connections/Rest_Connection.py", line 284, in _http_request self.log.debug(''.join(traceback.format_stack())) 2021-11-22 06:44:41,516 | infra | DEBUG | pool-3-thread-20 | [task:call:6532] Status of the query 0 2021-11-22 06:44:41,516 | infra | INFO | pool-3-thread-20 | [task:call:6534] check isIndexQuery statusTrue 2021-11-22 06:44:41,516 | infra | INFO | pool-3-thread-20 | [task:call:6540] Waiting for polling status:default__default__default_2 2021-11-22 06:44:41,517 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default__default__default_2 2021-11-22 06:44:41,561 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:41,562 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:42,562 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 0 2021-11-22 06:44:42,607 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:42,607 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:43,608 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 1 2021-11-22 06:44:43,654 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:43,654 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:44,655 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 2 2021-11-22 06:44:44,700 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:44,701 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:45,703 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 3 2021-11-22 06:44:45,746 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:45,746 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:46,747 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 4 2021-11-22 06:44:46,811 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:46,812 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:47,812 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 5 2021-11-22 06:44:47,862 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:47,864 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:48,865 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 6 2021-11-22 06:44:48,907 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:48,908 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:49,910 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 7 2021-11-22 06:44:49,957 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:49,959 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:50,959 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 8 2021-11-22 06:44:51,000 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:51,000 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:52,002 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 9 2021-11-22 06:44:52,042 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:52,042 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:53,043 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 10 2021-11-22 06:44:53,088 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:53,088 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:54,089 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 11 2021-11-22 06:44:54,140 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:54,140 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:55,141 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 12 2021-11-22 06:44:55,198 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:55,200 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:56,200 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 13 2021-11-22 06:44:56,252 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:56,253 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:57,253 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 14 2021-11-22 06:44:57,306 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:57,308 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:58,308 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 15 2021-11-22 06:44:58,358 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:58,359 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:44:59,361 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 16 2021-11-22 06:44:59,407 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:44:59,407 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:00,408 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 17 2021-11-22 06:45:00,457 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:00,457 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:01,459 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 18 2021-11-22 06:45:01,506 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:01,506 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:02,507 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 19 2021-11-22 06:45:02,552 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:02,553 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:03,555 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 20 2021-11-22 06:45:03,599 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:03,599 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:04,601 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 21 2021-11-22 06:45:04,663 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:04,664 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:05,664 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 22 2021-11-22 06:45:05,697 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:05,697 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:06,697 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 23 2021-11-22 06:45:06,736 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:06,737 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:07,737 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 24 2021-11-22 06:45:07,783 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:07,783 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:08,785 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 25 2021-11-22 06:45:08,825 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:08,826 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:09,828 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 26 2021-11-22 06:45:09,874 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:09,875 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:10,875 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 27 2021-11-22 06:45:10,914 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:10,914 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:11,915 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 28 2021-11-22 06:45:11,960 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:11,961 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:12,961 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 29 2021-11-22 06:45:13,002 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:13,003 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:14,003 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 30 2021-11-22 06:45:14,045 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:14,045 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:15,046 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 31 2021-11-22 06:45:15,089 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:15,091 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:16,091 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 32 2021-11-22 06:45:16,130 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:16,131 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:17,131 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 33 2021-11-22 06:45:17,171 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:17,173 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:18,173 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 34 2021-11-22 06:45:18,213 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:18,213 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:19,213 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 35 2021-11-22 06:45:19,255 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:19,256 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:20,256 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 36 2021-11-22 06:45:20,319 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:20,321 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:21,321 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 37 2021-11-22 06:45:21,361 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:21,361 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:22,361 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 38 2021-11-22 06:45:22,403 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:22,404 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:23,404 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 39 2021-11-22 06:45:23,446 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:23,446 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:24,447 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 40 2021-11-22 06:45:24,484 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:24,486 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:25,486 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 41 2021-11-22 06:45:25,526 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:25,526 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:26,528 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 42 2021-11-22 06:45:26,566 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:26,566 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:27,568 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 43 2021-11-22 06:45:27,611 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:27,611 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:28,611 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 44 2021-11-22 06:45:28,653 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:45:28,654 | test | DEBUG | pool-3-thread-20 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:45:29,654 | infra | INFO | pool-3-thread-20 | [GsiHelper_Rest:polling_create_index_status:376] Index default__default__default_2 not found with iteration 45 2021-11-22 06:45:29,690 | infra | INFO | pool-3-thread-20 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default__default__default_2` ON `default`.`_default`.`_default`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592254.35' completed 2021-11-22 06:45:29,691 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection1_2` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 } 2021-11-22 06:45:29,691 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection1_2 2021-11-22 06:45:29,726 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_2` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592329.69 2021-11-22 06:45:29,726 | infra | INFO | pool-3-thread-19 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_2` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592329.69' started 2021-11-22 06:45:29,726 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_2` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592329.69 2021-11-22 06:45:29,760 | infra | INFO | pool-3-thread-19 | [task:call:6525] starting call 2021-11-22 06:45:29,762 | infra | DEBUG | pool-3-thread-19 | [GsiHelper_Rest:execute_query:419] Query params: statement=CREATE+INDEX+%60default_Scope1_FunctionCollection1_2%60+ON+%60default%60.%60Scope1%60.%60FunctionCollection1%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D 2021-11-22 06:46:43,167 | infra | DEBUG | pool-3-thread-19 | [task:call:6532] Status of the query 1 2021-11-22 06:46:43,167 | infra | INFO | pool-3-thread-19 | [task:call:6534] check isIndexQuery statusTrue 2021-11-22 06:46:43,168 | infra | INFO | pool-3-thread-19 | [task:call:6540] Waiting for polling status:default_Scope1_FunctionCollection1_2 2021-11-22 06:46:43,168 | infra | INFO | pool-3-thread-19 | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection1_2 2021-11-22 06:46:43,210 | test | DEBUG | pool-3-thread-19 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:46:43,211 | test | DEBUG | pool-3-thread-19 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:46:44,213 | infra | INFO | pool-3-thread-19 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection1_2 not found with iteration 0 2021-11-22 06:46:44,247 | infra | INFO | pool-3-thread-19 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection1_2` ON `default`.`Scope1`.`FunctionCollection1`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592329.69' completed 2021-11-22 06:46:44,249 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:90] sending query:CREATE INDEX `default_Scope1_FunctionCollection0_2` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': False, 'num_replica': 0 } 2021-11-22 06:46:44,250 | test | DEBUG | MainThread | [index_ready_functions:create_gsi_on_each_collection:91] Sending index name:default_Scope1_FunctionCollection0_2 2021-11-22 06:46:44,289 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_2` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592404.25 2021-11-22 06:46:44,289 | infra | INFO | pool-3-thread-6 | [task:start_task:89] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_2` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592404.25' started 2021-11-22 06:46:44,289 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_2` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592404.25 2021-11-22 06:46:44,329 | infra | INFO | pool-3-thread-6 | [task:call:6525] starting call 2021-11-22 06:46:44,331 | infra | DEBUG | pool-3-thread-6 | [GsiHelper_Rest:execute_query:419] Query params: statement=CREATE+INDEX+%60default_Scope1_FunctionCollection0_2%60+ON+%60default%60.%60Scope1%60.%60FunctionCollection0%60%28%60body%60%29+WITH+%7B+%27defer_build%27%3A+False%2C+%27num_replica%27%3A+0+%7D 2021-11-22 06:47:50,637 | infra | DEBUG | pool-3-thread-6 | [task:call:6532] Status of the query 1 2021-11-22 06:47:50,638 | infra | INFO | pool-3-thread-6 | [task:call:6534] check isIndexQuery statusTrue 2021-11-22 06:47:50,638 | infra | INFO | pool-3-thread-6 | [task:call:6540] Waiting for polling status:default_Scope1_FunctionCollection0_2 2021-11-22 06:47:50,638 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:368] Starting polling for index:default_Scope1_FunctionCollection0_2 2021-11-22 06:47:50,691 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:47:50,693 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:47:51,694 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_2 not found with iteration 0 2021-11-22 06:47:51,740 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:47:51,740 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:47:52,740 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_2 not found with iteration 1 2021-11-22 06:47:52,782 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:47:52,782 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:47:53,783 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_2 not found with iteration 2 2021-11-22 06:47:53,825 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:47:53,826 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:47:54,828 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_2 not found with iteration 3 2021-11-22 06:47:54,878 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:17] Sleep is called from lib/gsiLib/GsiHelper_Rest.py -> polling_create_index_status():L375 2021-11-22 06:47:54,878 | test | DEBUG | pool-3-thread-6 | [common_lib:sleep:24] Sleep 1 seconds. Reason: None 2021-11-22 06:47:55,878 | infra | INFO | pool-3-thread-6 | [GsiHelper_Rest:polling_create_index_status:376] Index default_Scope1_FunctionCollection0_2 not found with iteration 4 2021-11-22 06:47:55,917 | infra | INFO | pool-3-thread-6 | [task:complete_task:104] Thread 'ExecuteQueriesTask_CREATE INDEX `default_Scope1_FunctionCollection0_2` ON `default`.`Scope1`.`FunctionCollection0`(`body`) WITH { 'defer_build': False, 'num_replica': 0 }started1637592404.25' completed 2021-11-22 06:47:55,960 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_DROP INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`USING GSIstarted1637592475.92 2021-11-22 06:47:55,960 | infra | INFO | pool-3-thread-1 | [task:start_task:89] Thread 'ExecuteQueriesTask_DROP INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`USING GSIstarted1637592475.92' started 2021-11-22 06:47:56,002 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_DROP INDEX `default__default__default_1` ON `default`.`_default`.`_default`USING GSIstarted1637592475.96 2021-11-22 06:47:56,002 | infra | INFO | pool-3-thread-24 | [task:start_task:89] Thread 'ExecuteQueriesTask_DROP INDEX `default__default__default_1` ON `default`.`_default`.`_default`USING GSIstarted1637592475.96' started 2021-11-22 06:47:56,003 | infra | INFO | pool-3-thread-1 | [task:call:6525] starting call 2021-11-22 06:47:56,046 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`USING GSIstarted1637592476.0 2021-11-22 06:47:56,048 | infra | INFO | pool-3-thread-30 | [task:start_task:89] Thread 'ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`USING GSIstarted1637592476.0' started 2021-11-22 06:47:56,048 | infra | INFO | pool-3-thread-24 | [task:call:6525] starting call 2021-11-22 06:47:56,086 | infra | INFO | pool-3-thread-23 | [task:start_task:89] Thread 'ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`USING GSIstarted1637592476.05' started 2021-11-22 06:47:56,086 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`USING GSIstarted1637592476.05 2021-11-22 06:47:56,088 | test | INFO | MainThread | [plasma_stats:test_system_stability_with_indexer:700] Starting rebalance in and rebalance out task 2021-11-22 06:47:56,092 | infra | INFO | pool-3-thread-30 | [task:call:6525] starting call 2021-11-22 06:47:56,131 | infra | INFO | pool-3-thread-23 | [task:call:6525] starting call 2021-11-22 06:47:56,180 | infra | DEBUG | pool-3-thread-1 | [task:call:6532] Status of the query 1 2021-11-22 06:47:56,180 | infra | INFO | pool-3-thread-1 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:47:56,180 | infra | INFO | MainThread | [task_manager:add_new_task:22] Added new task: Rebalance_task_IN=[172.23.105.226,172.23.105.227]_OUT=[]_1637592476.09 2021-11-22 06:47:56,180 | infra | INFO | pool-3-thread-1 | [task:complete_task:104] Thread 'ExecuteQueriesTask_DROP INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`USING GSIstarted1637592475.92' completed 2021-11-22 06:47:56,180 | infra | INFO | pool-3-thread-28 | [task:start_task:89] Thread 'Rebalance_task_IN=[172.23.105.226,172.23.105.227]_OUT=[]_1637592476.09' started 2021-11-22 06:47:56,181 | infra | DEBUG | MainThread | [task_manager:get_task_result:25] Getting task result for Rebalance_task_IN=[172.23.105.226,172.23.105.227]_OUT=[]_1637592476.09 2021-11-22 06:47:56,186 | test | DEBUG | pool-3-thread-28 | [rest_client:add_node:1177] Adding remote node 172.23.105.226:8091 to cluster 172.23.105.223:8091 2021-11-22 06:47:56,210 | infra | DEBUG | pool-3-thread-23 | [task:call:6532] Status of the query 1 2021-11-22 06:47:56,210 | infra | INFO | pool-3-thread-23 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:47:56,211 | infra | INFO | pool-3-thread-23 | [task:complete_task:104] Thread 'ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`USING GSIstarted1637592476.05' completed 2021-11-22 06:47:56,351 | infra | DEBUG | pool-3-thread-24 | [task:call:6532] Status of the query 1 2021-11-22 06:47:56,351 | infra | INFO | pool-3-thread-24 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:47:56,351 | infra | INFO | pool-3-thread-24 | [task:complete_task:104] Thread 'ExecuteQueriesTask_DROP INDEX `default__default__default_1` ON `default`.`_default`.`_default`USING GSIstarted1637592475.96' completed 2021-11-22 06:47:56,430 | infra | DEBUG | pool-3-thread-30 | [task:call:6532] Status of the query 1 2021-11-22 06:47:56,430 | infra | INFO | pool-3-thread-30 | [task:call:6534] check isIndexQuery statusFalse 2021-11-22 06:47:56,430 | infra | INFO | pool-3-thread-30 | [task:complete_task:104] Thread 'ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`USING GSIstarted1637592476.0' completed 2021-11-22 06:48:07,905 | test | DEBUG | pool-3-thread-28 | [rest_client:add_node:1177] Adding remote node 172.23.105.227:8091 to cluster 172.23.105.223:8091 2021-11-22 06:48:19,809 | test | DEBUG | pool-3-thread-28 | [rest_client:rebalance:1430] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.105.226,ns_1@172.23.105.220,ns_1@172.23.105.223,ns_1@172.23.105.227,ns_1@172.23.105.221,ns_1@172.23.105.208', 'ejectedNodes': '', 'user': 'Administrator'} 2021-11-22 06:48:19,910 | test | DEBUG | pool-3-thread-28 | [rest_client:rebalance:1435] Rebalance operation started 2021-11-22 06:48:19,914 | test | INFO | pool-3-thread-28 | [table_view:display:72] Rebalance Overview +----------------+-------------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+-------------+-----------------------+---------------+--------------+ | 172.23.105.220 | index, n1ql | 7.1.0-1695-enterprise | 2.66461696131 | Cluster node | | 172.23.105.223 | kv | 7.1.0-1695-enterprise | 7.37829614604 | Cluster node | | 172.23.105.221 | index, n1ql | 7.1.0-1695-enterprise | 82.9715762274 | Cluster node | | 172.23.105.208 | kv, n1ql | 7.1.0-1695-enterprise | 9.57230142566 | Cluster node | | 172.23.105.226 | ['index'] | | | <--- IN --- | | 172.23.105.227 | ['n1ql'] | | | <--- IN --- | +----------------+-------------+-----------------------+---------------+--------------+ 2021-11-22 06:48:19,951 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 0.00 % 2021-11-22 06:48:19,953 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 0.0 2021-11-22 06:48:20,022 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:48:20,030 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:48:20,032 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:48:30,075 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:48:30,075 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:48:30,122 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:48:30,128 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:48:30,128 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:48:40,180 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:48:40,180 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:48:40,246 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:48:40,252 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:48:40,252 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:48:50,305 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:48:50,306 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:48:50,365 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:48:50,375 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:48:50,375 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:00,414 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:00,415 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:00,464 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:00,470 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:00,470 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:10,505 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:10,505 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:10,555 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:10,559 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:10,561 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:20,598 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:20,598 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:20,644 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:20,650 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:20,650 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:30,691 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:30,691 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:30,736 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:30,743 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:30,744 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:40,782 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:40,783 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:40,832 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:40,838 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:40,839 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:49:50,884 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:49:50,885 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:49:50,930 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:49:50,937 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:49:50,937 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:00,973 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:00,973 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:01,023 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:01,029 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:01,029 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:11,069 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:11,071 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:11,119 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:11,127 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:11,127 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:21,151 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:21,153 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:21,203 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:21,209 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:21,210 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:31,246 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:31,247 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:31,296 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:31,302 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:31,302 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:41,336 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:41,338 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:41,384 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:41,391 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:41,391 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:50:51,430 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:50:51,430 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:50:51,479 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:50:51,484 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:50:51,484 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:01,542 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:01,543 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:01,592 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:01,598 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:01,598 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:11,631 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:11,632 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:11,677 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:11,684 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:11,684 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:21,719 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:21,719 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:21,759 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:21,765 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:21,766 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:31,802 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:31,803 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:31,848 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:31,855 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:31,855 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:41,907 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:41,907 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:41,960 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:41,967 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:41,967 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:51:52,043 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:51:52,045 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:51:52,121 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:51:52,130 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:51:52,131 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:52:02,174 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:52:02,174 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:52:02,217 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:52:02,223 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:52:02,224 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:52:12,262 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:52:12,263 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:52:12,312 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:52:12,319 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:52:12,319 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:52:22,355 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:52:22,357 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:52:22,405 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:52:22,413 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:52:22,413 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:52:32,460 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:52:32,460 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:52:32,515 | infra | DEBUG | pool-3-thread-28 | [task:check:411] Wait before next rebalance progress check 2021-11-22 06:52:32,522 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> check():L412 2021-11-22 06:52:32,523 | infra | DEBUG | pool-3-thread-28 | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-11-22 06:52:42,565 | test | DEBUG | pool-3-thread-28 | [rest_client:_rebalance_status_and_progress:1644] Rebalance percentage: 28.33 % 2021-11-22 06:52:42,565 | test | INFO | pool-3-thread-28 | [task:check:384] Rebalance - status: running, progress: 28.33 2021-11-22 06:52:42,936 | test | INFO | pool-3-thread-28 | [rest_client:print_UI_logs:2788] Latest logs from UI on 172.23.105.223: 2021-11-22 06:52:42,937 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.105.223', u'tstamp': 1637592500411L, u'shortText': u'message', u'serverTime': u'2021-11-22T06:48:20.411Z', u'text': u'Bucket "default" rebalance appears to be swap rebalance'} 2021-11-22 06:52:42,940 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.105.223', u'tstamp': 1637592500204L, u'shortText': u'message', u'serverTime': u'2021-11-22T06:48:20.204Z', u'text': u'Started rebalancing bucket default'} 2021-11-22 06:52:42,940 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'info', u'node': u'ns_1@172.23.105.223', u'tstamp': 1637592499818L, u'shortText': u'message', u'serverTime': u'2021-11-22T06:48:19.818Z', u'text': u"Starting rebalance, KeepNodes = ['ns_1@172.23.105.226','ns_1@172.23.105.220',\n 'ns_1@172.23.105.223','ns_1@172.23.105.227',\n 'ns_1@172.23.105.221','ns_1@172.23.105.208'], EjectNodes = [], Failed over and being ejected nodes = []; no delta recovery nodes; Operation Id = a797bec067211ef6e831c1f02276847a"} 2021-11-22 06:52:42,941 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 0, u'module': u'memcached_config_mgr', u'type': u'info', u'node': u'ns_1@172.23.105.227', u'tstamp': 1637592499688L, u'shortText': u'message', u'serverTime': u'2021-11-22T06:48:19.688Z', u'text': u'Hot-reloaded memcached.json for config change of the following keys: [<<"num_reader_threads">>,\n <<"num_writer_threads">>,\n <<"scramsha_fallback_salt">>]'} 2021-11-22 06:52:42,943 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 3, u'module': u'ns_cluster', u'type': u'info', u'node': u'ns_1@172.23.105.227', u'tstamp': 1637592499525L, u'shortText': u'message', u'serverTime': u'2021-11-22T06:48:19.525Z', u'text': u'Node ns_1@172.23.105.227 joined cluster'} 2021-11-22 06:52:42,944 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 1, u'module': u'menelaus_web_sup', u'type': u'info', u'node': u'ns_1@172.23.105.227', u'tstamp': 1637592499487L, u'shortText': u'web start ok', u'serverTime': u'2021-11-22T06:48:19.487Z', u'text': u'Couchbase Server has started on web port 8091 on node \'ns_1@172.23.105.227\'. Version: "7.1.0-1695-enterprise".'} 2021-11-22 06:52:42,944 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.105.208', u'tstamp': 1637592496101L, u'shortText': u'node up', u'serverTime': u'2021-11-22T06:48:16.101Z', u'text': u"Node 'ns_1@172.23.105.208' saw that node 'ns_1@172.23.105.227' came up. Tags: []"} 2021-11-22 06:52:42,946 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.105.220', u'tstamp': 1637592496101L, u'shortText': u'node up', u'serverTime': u'2021-11-22T06:48:16.101Z', u'text': u"Node 'ns_1@172.23.105.220' saw that node 'ns_1@172.23.105.227' came up. Tags: []"} 2021-11-22 06:52:42,947 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.105.226', u'tstamp': 1637592495884L, u'shortText': u'node up', u'serverTime': u'2021-11-22T06:48:15.884Z', u'text': u"Node 'ns_1@172.23.105.226' saw that node 'ns_1@172.23.105.227' came up. Tags: []"} 2021-11-22 06:52:42,948 | test | ERROR | pool-3-thread-28 | [rest_client:print_UI_logs:2790] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.105.221', u'tstamp': 1637592495877L, u'shortText': u'node up', u'serverTime': u'2021-11-22T06:48:15.877Z', u'text': u"Node 'ns_1@172.23.105.221' saw that node 'ns_1@172.23.105.227' came up. Tags: []"} 2021-11-22 06:52:42,950 | test | ERROR | pool-3-thread-28 | [task:call:296] Rebalance Failed: seems like rebalance hangs. please check logs! 2021-11-22 06:52:43,085 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:649] All nodes in cluster: [ip:172.23.105.226 port:8091 ssh_username:root, ip:172.23.105.220 port:8091 ssh_username:root, ip:172.23.105.221 port:8091 ssh_username:root] FAIL 2021-11-22 06:52:43,230 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-------------+-----------------+-----------+------------+-----------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-------------+-----------------+-----------+------------+-----------------------+-------------------+-----------------------+ | 172.23.105.226 | index | 45.7318861836 | 3.91 GiB | 1.49 GiB | 170.09 MiB / 3.50 GiB | 0 / 0 | 7.1.0-1695-enterprise | | 172.23.105.220 | index, n1ql | 3.47311551325 | 3.91 GiB | 1.73 GiB | 334.61 MiB / 3.50 GiB | 0 / 0 | 7.1.0-1695-enterprise | | 172.23.105.223 | kv | 6.61468812877 | 3.91 GiB | 603.29 MiB | 156.25 MiB / 3.50 GiB | 4224000 / 4224000 | 7.1.0-1695-enterprise | | 172.23.105.227 | n1ql | 2.0495951417 | 3.91 GiB | 3.29 GiB | 0.0 Byte / 0.0 Byte | 0 / 0 | 7.1.0-1695-enterprise | | 172.23.105.221 | index, n1ql | 3.04425684318 | 3.91 GiB | 2.07 GiB | 0.0 Byte / 0.0 Byte | 0 / 0 | 7.1.0-1695-enterprise | | 172.23.105.208 | kv, n1ql | 4.9758822036 | 3.91 GiB | 734.65 MiB | 653.46 MiB / 3.50 GiB | 4224000 / 4224000 | 7.1.0-1695-enterprise | +----------------+-------------+-----------------+-----------+------------+-----------------------+-------------------+-----------------------+ 2021-11-22 06:52:43,815 | test | INFO | MainThread | [storage_base:tearDown:621] ## Active Resident Threshold of default is 79.4098484848 ## 2021-11-22 06:52:43,815 | infra | INFO | MainThread | [task_manager:shutdown:64] Running TaskManager shutdown 2021-11-22 06:52:43,821 | infra | INFO | MainThread | [task_manager:shutdown:64] Running TaskManager shutdown 2021-11-22 06:52:43,822 | infra | WARNING | MainThread | [cluster:shutdown:707] Cluster instance shutdown with force 2021-11-22 06:52:43,822 | infra | INFO | MainThread | [task_manager:abort_all_tasks:86] Stopping task ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`USING GSIstarted1637592476.05 2021-11-22 06:52:43,822 | infra | DEBUG | MainThread | [task_manager:abort_all_tasks:91] Task ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection0_1` ON `default`.`Scope1`.`FunctionCollection0`USING GSIstarted1637592476.05 could not be cancelled or already finished. 2021-11-22 06:52:43,822 | infra | INFO | MainThread | [task_manager:abort_all_tasks:86] Stopping task ExecuteQueriesTask_DROP INDEX `default__default__default_1` ON `default`.`_default`.`_default`USING GSIstarted1637592475.96 2021-11-22 06:52:43,822 | infra | DEBUG | MainThread | [task_manager:abort_all_tasks:91] Task ExecuteQueriesTask_DROP INDEX `default__default__default_1` ON `default`.`_default`.`_default`USING GSIstarted1637592475.96 could not be cancelled or already finished. 2021-11-22 06:52:43,823 | infra | INFO | MainThread | [task_manager:abort_all_tasks:86] Stopping task ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637591934.17 2021-11-22 06:52:43,823 | infra | DEBUG | MainThread | [task_manager:abort_all_tasks:91] Task ExecuteQueriesTask_select * from `default`.`Scope1`.`FunctionCollection0` data USE INDEX (default_Scope1_FunctionCollection0_1 USING GSI) where body is not missing order by meta().id limit 50000 offset 2100000started1637591934.17 could not be cancelled or already finished. 2021-11-22 06:52:43,823 | infra | INFO | MainThread | [task_manager:abort_all_tasks:86] Stopping task ExecuteQueriesTask_DROP INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`USING GSIstarted1637592475.92 2021-11-22 06:52:43,825 | infra | DEBUG | MainThread | [task_manager:abort_all_tasks:91] Task ExecuteQueriesTask_DROP INDEX `default__default_FunctionCollection1_1` ON `default`.`_default`.`FunctionCollection1`USING GSIstarted1637592475.92 could not be cancelled or already finished. 2021-11-22 06:52:43,825 | infra | INFO | MainThread | [task_manager:abort_all_tasks:86] Stopping task ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`USING GSIstarted1637592476.0 2021-11-22 06:52:43,825 | infra | DEBUG | MainThread | [task_manager:abort_all_tasks:91] Task ExecuteQueriesTask_DROP INDEX `default_Scope1_FunctionCollection1_1` ON `default`.`Scope1`.`FunctionCollection1`USING GSIstarted1637592476.0 could not be cancelled or already finished. 2021-11-22 06:52:43,825 | infra | DEBUG | MainThread | [sdk_client3:shutdown:80] Closing clients from SDKClientPool 2021-11-22 06:52:43,826 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,868 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,868 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,888 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,890 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,911 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,911 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,933 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,934 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,953 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,953 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,970 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,971 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:43,989 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:43,990 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,005 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,006 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,022 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,023 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,040 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,040 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,056 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,058 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,076 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,078 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,092 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,094 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,108 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,108 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,124 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,125 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,145 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,147 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,167 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,168 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,194 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,194 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,213 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,213 | test | DEBUG | MainThread | [sdk_client3:close:323] Closing SDK for bucket 'default' 2021-11-22 06:52:44,233 | test | DEBUG | MainThread | [sdk_client3:close:327] Cluster disconnected and env shutdown 2021-11-22 06:52:44,250 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-22 06:52:44,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:44,887 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-22 06:52:45,130 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:45,131 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-22 06:52:45,163 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-22 06:52:45,197 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-22 06:52:45,229 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-22 06:52:45,267 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-22 06:52:45,299 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-22 06:52:45,326 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-22 06:52:45,357 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:45,394 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.223: No crash files found 2021-11-22 06:52:47,075 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:47,115 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:47,181 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:47,242 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:47,276 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:47,309 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000001.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:47,365 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000001.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:47,426 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000001.txt 2021-11-22 06:52:47,467 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000001.txt 2021-11-22 06:52:47,509 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000002.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:47,571 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000002.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:47,625 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000002.txt 2021-11-22 06:52:47,668 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000002.txt 2021-11-22 06:52:47,710 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000003.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:47,772 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000003.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:47,823 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000003.txt 2021-11-22 06:52:47,864 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000003.txt 2021-11-22 06:52:47,904 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:47,937 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.223: No 'sanitizers.log.*' files found 2021-11-22 06:52:47,938 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:47,971 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:48,007 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:48,038 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.223: No 'indexer.log*' files found 2021-11-22 06:52:48,039 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-22 06:52:48,062 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-22 06:52:48,375 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:48,763 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-22 06:52:48,959 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:48,960 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-22 06:52:48,987 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-22 06:52:49,019 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-22 06:52:49,052 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-22 06:52:49,095 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-22 06:52:49,124 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-22 06:52:49,154 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-22 06:52:49,193 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:49,230 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.221: No crash files found 2021-11-22 06:52:49,516 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:49,555 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:49,594 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:49,630 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:49,661 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:49,694 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:49,727 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.221: No 'sanitizers.log.*' files found 2021-11-22 06:52:49,729 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:49,762 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:49,802 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:49,834 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: grep -r 'panic' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:49,911 | test | CRITICAL | MainThread | [basetestcase:check_logs:828] /home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72 does not match any timestamp 2021-11-22 06:52:49,914 | test | CRITICAL | MainThread | [basetestcase:check_logs:828] /home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72 does not match any timestamp 2021-11-22 06:52:49,914 | test | INFO | MainThread | [basetestcase:check_coredump_exist:941] unwanted messages in /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:49,915 | test | CRITICAL | MainThread | [basetestcase:check_coredump_exist:943] 172.23.105.221: Found 'panic' logs - ['\t/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72\n', '\t/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72\n', '\t/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72\n', '\t/home/couchbase/.cbdepscache/exploded/x86_64/go-1.16.5/go/src/runtime/panic.go:1117 +0x72\n'] 2021-11-22 06:52:49,915 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-22 06:52:49,931 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-22 06:52:50,191 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:50,575 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-22 06:52:50,766 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:50,767 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-22 06:52:50,799 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-22 06:52:50,832 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-22 06:52:50,864 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-22 06:52:50,903 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-22 06:52:50,933 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-22 06:52:50,967 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-22 06:52:51,002 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:51,038 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.220: No crash files found 2021-11-22 06:52:51,229 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:51,263 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:51,299 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:51,335 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:51,368 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:51,401 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:51,434 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.220: No 'sanitizers.log.*' files found 2021-11-22 06:52:51,436 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:51,461 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:51,502 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:51,532 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'panic' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,598 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'fatal' /opt/couchbase/var/lib/couchbase/logs/indexer.log | grep -v 'fatal remote' 2021-11-22 06:52:51,648 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'Error parsing XATTR' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,686 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'protobuf.Error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,732 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'Encounter planner error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,773 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'corruption' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,815 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'processFlushAbort' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,861 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'found missing page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,904 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'invalid last page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,948 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: grep -r 'Storage corrupted and unrecoverable' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:51,990 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-22 06:52:52,006 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-22 06:52:52,292 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:52,660 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-22 06:52:52,941 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:52,943 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-22 06:52:52,974 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-22 06:52:53,007 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-22 06:52:53,039 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-22 06:52:53,076 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-22 06:52:53,107 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-22 06:52:53,138 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-22 06:52:53,168 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:53,201 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.208: No crash files found 2021-11-22 06:52:53,377 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:53,410 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:53,479 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:53,529 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:53,572 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:53,611 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:53,641 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.208: No 'sanitizers.log.*' files found 2021-11-22 06:52:53,641 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:53,674 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:53,713 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:53,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'panic' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,776 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'fatal' /opt/couchbase/var/lib/couchbase/logs/indexer.log | grep -v 'fatal remote' 2021-11-22 06:52:53,802 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'Error parsing XATTR' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,825 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'protobuf.Error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,855 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'Encounter planner error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,887 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'corruption' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,911 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'processFlushAbort' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,934 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'found missing page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,963 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'invalid last page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:53,989 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: grep -r 'Storage corrupted and unrecoverable' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:54,013 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-22 06:52:54,029 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-22 06:52:54,367 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:54,683 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-22 06:52:54,799 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:54,801 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-22 06:52:54,831 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-22 06:52:54,859 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-22 06:52:54,880 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-22 06:52:54,911 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-22 06:52:54,931 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-22 06:52:54,950 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-22 06:52:54,973 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:54,999 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.226: No crash files found 2021-11-22 06:52:55,213 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:55,240 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:55,263 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:55,289 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:55,313 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:55,332 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:55,349 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.226: No 'sanitizers.log.*' files found 2021-11-22 06:52:55,351 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:55,378 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:55,411 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:55,434 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'panic' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,464 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'fatal' /opt/couchbase/var/lib/couchbase/logs/indexer.log | grep -v 'fatal remote' 2021-11-22 06:52:55,496 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'Error parsing XATTR' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,519 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'protobuf.Error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,542 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'Encounter planner error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,565 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'corruption' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,582 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'processFlushAbort' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'found missing page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,625 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'invalid last page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,644 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: grep -r 'Storage corrupted and unrecoverable' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:55,661 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-22 06:52:55,678 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-22 06:52:55,878 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:52:56,174 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-22 06:52:56,312 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:52:56,315 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-22 06:52:56,354 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-22 06:52:56,387 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-22 06:52:56,418 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-22 06:52:56,457 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-22 06:52:56,490 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-22 06:52:56,519 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-22 06:52:56,555 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls -lt /opt/couchbase/var/lib/couchbase/crash/ 2021-11-22 06:52:56,588 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:873] 172.23.105.227: No crash files found 2021-11-22 06:52:56,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /opt/couchbase/var/lib/couchbase/logs/memcached.log.* 2021-11-22 06:52:56,782 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:56,818 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r ' ERROR ' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt | grep -v 'XERROR' | grep -v 'compaction failed for vb' | grep -v 'failed - Already exists' 2021-11-22 06:52:56,852 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'exception occurred in runloop' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:56,881 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'Stream request failed because the snap start seqno' /opt/couchbase/var/lib/couchbase/logs/memcached.log.000000.txt 2021-11-22 06:52:56,911 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /opt/couchbase/var/lib/couchbase/logs/sanitizers.log.* 2021-11-22 06:52:56,944 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:892] 172.23.105.227: No 'sanitizers.log.*' files found 2021-11-22 06:52:56,944 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /opt/couchbase/var/lib/couchbase/logs/babysitter.log 2021-11-22 06:52:56,977 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r ' CRITICAL ' /opt/couchbase/var/lib/couchbase/logs/babysitter.log | grep -v 'Rollback point not found' | grep -v 'No space left on device' | grep -v 'Permission denied' | grep -v 'write traffic will be disabled for this node' 2021-11-22 06:52:57,017 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /opt/couchbase/var/lib/couchbase/logs/indexer.log* 2021-11-22 06:52:57,046 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'panic' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,076 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'fatal' /opt/couchbase/var/lib/couchbase/logs/indexer.log | grep -v 'fatal remote' 2021-11-22 06:52:57,111 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'Error parsing XATTR' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,144 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'protobuf.Error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,174 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'Encounter planner error' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,206 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'corruption' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,240 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'processFlushAbort' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,272 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'found missing page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,302 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'invalid last page' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,335 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: grep -r 'Storage corrupted and unrecoverable' /opt/couchbase/var/lib/couchbase/logs/indexer.log 2021-11-22 06:52:57,371 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-22 06:52:57,497 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1152] Running cbcollect on node ns_1@172.23.105.208,ns_1@172.23.105.220,ns_1@172.23.105.221,ns_1@172.23.105.223,ns_1@172.23.105.226,ns_1@172.23.105.227 2021-11-22 06:52:57,551 | test | DEBUG | MainThread | [rest_client:_http_request:805] {'date': 'Mon, 22 Nov 2021 14:52:57 GMT', 'content-length': '2', 'server': 'Couchbase Server', 'expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'x-frame-options': 'DENY', 'x-permitted-cross-domain-policies': 'none', 'pragma': 'no-cache', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'connection': 'close', 'content-type': 'application/json', 'cache-control': 'no-cache,no-store,must-revalidate', 'status': '200'} 2021-11-22 06:52:57,552 | test | DEBUG | MainThread | [rest_client:_http_request:806] [] 2021-11-22 06:52:57,578 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> trigger_cb_collect_on_cluster():L1154 2021-11-22 06:52:57,579 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: Wait for CB collect to start 2021-11-22 06:53:07,581 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1155] ns_1@172.23.105.208,ns_1@172.23.105.220,ns_1@172.23.105.221,ns_1@172.23.105.223,ns_1@172.23.105.226,ns_1@172.23.105.227 - cbcollect status: True 2021-11-22 06:53:07,582 | test | INFO | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1160] Polling active_tasks to check cbcollect status 2021-11-22 06:53:07,621 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 0 - running 2021-11-22 06:53:07,644 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:07,644 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:53:17,690 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 1 - running 2021-11-22 06:53:17,716 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:17,717 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:53:27,765 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 2 - running 2021-11-22 06:53:27,792 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:27,792 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:53:37,834 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 3 - running 2021-11-22 06:53:37,859 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:37,859 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:53:47,898 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 4 - running 2021-11-22 06:53:47,924 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:47,924 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:53:57,964 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 5 - running 2021-11-22 06:53:57,987 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:53:57,989 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:08,026 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 6 - running 2021-11-22 06:54:08,049 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:08,051 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:18,088 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 7 - running 2021-11-22 06:54:18,105 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:18,105 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:28,148 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 8 - running 2021-11-22 06:54:28,180 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:28,180 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:38,221 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 9 - running 2021-11-22 06:54:38,250 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:38,252 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:48,292 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 10 - running 2021-11-22 06:54:48,316 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:48,316 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:54:58,355 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 11 - running 2021-11-22 06:54:58,378 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:54:58,380 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:08,421 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 12 - running 2021-11-22 06:55:08,446 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:08,446 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:18,483 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 13 - running 2021-11-22 06:55:18,506 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:18,506 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:28,545 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 14 - running 2021-11-22 06:55:28,569 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:28,575 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:38,858 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 15 - running 2021-11-22 06:55:38,931 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:38,933 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:48,973 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 16 - running 2021-11-22 06:55:48,996 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:48,997 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:55:59,038 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 17 - running 2021-11-22 06:55:59,063 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:55:59,065 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:09,101 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 18 - running 2021-11-22 06:56:09,125 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:56:09,125 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:19,161 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 19 - running 2021-11-22 06:56:19,184 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:56:19,184 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:29,221 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 20 - running 2021-11-22 06:56:29,243 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:56:29,243 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:39,276 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 21 - running 2021-11-22 06:56:39,299 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:56:39,301 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:49,335 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 22 - running 2021-11-22 06:56:49,357 | infra | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> wait_for_cb_collect_to_complete():L1177 2021-11-22 06:56:49,358 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-11-22 06:56:59,394 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1167] CBCollectInfo Iteration 23 - completed 2021-11-22 06:56:59,427 | test | DEBUG | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1183] {u'perNode': {u'ns_1@172.23.105.227': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.227.zip', u'status': u'collected'}, u'ns_1@172.23.105.226': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.226.zip', u'status': u'collected'}, u'ns_1@172.23.105.223': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.223.zip', u'status': u'collected'}, u'ns_1@172.23.105.221': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.221.zip', u'status': u'collected'}, u'ns_1@172.23.105.220': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.220.zip', u'status': u'collected'}, u'ns_1@172.23.105.208': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.208.zip', u'status': u'collected'}}, u'type': u'clusterLogsCollection', u'node': u'ns_1@172.23.105.223', u'progress': 100, u'ts': u'2021-11-22 14:52:57', u'status': u'completed'} 2021-11-22 06:56:59,430 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.208: Copying cbcollect ZIP file to Client 2021-11-22 06:56:59,444 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.208 with username: root, password: couchbase 2021-11-22 06:56:59,721 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:00,036 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /etc/ 2021-11-22 06:57:00,180 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:00,183 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: ls /cygdrive/c/Windows 2021-11-22 06:57:00,217 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: uname -m 2021-11-22 06:57:00,246 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/cpuinfo 2021-11-22 06:57:00,276 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: df -Thl 2021-11-22 06:57:00,318 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: cat /proc/meminfo 2021-11-22 06:57:00,349 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname 2021-11-22 06:57:00,381 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: hostname -d 2021-11-22 06:57:01,591 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.208: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.208.zip 2021-11-22 06:57:01,635 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.208 2021-11-22 06:57:01,637 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.220: Copying cbcollect ZIP file to Client 2021-11-22 06:57:01,654 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.220 with username: root, password: couchbase 2021-11-22 06:57:01,821 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:02,079 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /etc/ 2021-11-22 06:57:02,220 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:02,220 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: ls /cygdrive/c/Windows 2021-11-22 06:57:02,253 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: uname -m 2021-11-22 06:57:02,283 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/cpuinfo 2021-11-22 06:57:02,313 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: df -Thl 2021-11-22 06:57:02,351 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: cat /proc/meminfo 2021-11-22 06:57:02,384 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname 2021-11-22 06:57:02,413 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: hostname -d 2021-11-22 06:57:02,877 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.220: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.220.zip 2021-11-22 06:57:02,914 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.220 2021-11-22 06:57:02,914 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.221: Copying cbcollect ZIP file to Client 2021-11-22 06:57:02,930 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.221 with username: root, password: couchbase 2021-11-22 06:57:03,121 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:03,413 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /etc/ 2021-11-22 06:57:03,551 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:03,552 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: ls /cygdrive/c/Windows 2021-11-22 06:57:03,585 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: uname -m 2021-11-22 06:57:03,615 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/cpuinfo 2021-11-22 06:57:03,648 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: df -Thl 2021-11-22 06:57:03,686 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: cat /proc/meminfo 2021-11-22 06:57:03,716 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname 2021-11-22 06:57:03,746 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: hostname -d 2021-11-22 06:57:04,601 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.221: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.221.zip 2021-11-22 06:57:04,644 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.221 2021-11-22 06:57:04,645 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.223: Copying cbcollect ZIP file to Client 2021-11-22 06:57:04,667 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.223 with username: root, password: couchbase 2021-11-22 06:57:04,969 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:05,289 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /etc/ 2021-11-22 06:57:05,437 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:05,437 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: ls /cygdrive/c/Windows 2021-11-22 06:57:05,471 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: uname -m 2021-11-22 06:57:05,503 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/cpuinfo 2021-11-22 06:57:05,536 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: df -Thl 2021-11-22 06:57:05,575 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: cat /proc/meminfo 2021-11-22 06:57:05,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname 2021-11-22 06:57:05,637 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: hostname -d 2021-11-22 06:57:06,884 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.223: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.223.zip 2021-11-22 06:57:06,928 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.223 2021-11-22 06:57:06,930 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.226: Copying cbcollect ZIP file to Client 2021-11-22 06:57:06,944 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.226 with username: root, password: couchbase 2021-11-22 06:57:07,203 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:07,450 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /etc/ 2021-11-22 06:57:07,556 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:07,558 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: ls /cygdrive/c/Windows 2021-11-22 06:57:07,579 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: uname -m 2021-11-22 06:57:07,605 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/cpuinfo 2021-11-22 06:57:07,621 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: df -Thl 2021-11-22 06:57:07,651 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: cat /proc/meminfo 2021-11-22 06:57:07,667 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname 2021-11-22 06:57:07,684 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: hostname -d 2021-11-22 06:57:08,040 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.226: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.226.zip 2021-11-22 06:57:08,072 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.226 2021-11-22 06:57:08,072 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1187] ns_1@172.23.105.227: Copying cbcollect ZIP file to Client 2021-11-22 06:57:08,086 | infra | DEBUG | MainThread | [remote_util:connect:207] Connecting to 172.23.105.227 with username: root, password: couchbase 2021-11-22 06:57:08,276 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: sw_vers | grep ProductVersion | awk '{ print $2 }' 2021-11-22 06:57:08,551 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /etc/ 2021-11-22 06:57:08,697 | infra | DEBUG | MainThread | [remote_util:extract_remote_info:3490] os_distro: CentOS, os_version: centos 7, is_linux_distro: True 2021-11-22 06:57:08,697 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: ls /cygdrive/c/Windows 2021-11-22 06:57:08,730 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: uname -m 2021-11-22 06:57:08,762 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/cpuinfo 2021-11-22 06:57:08,792 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: df -Thl 2021-11-22 06:57:08,832 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: cat /proc/meminfo 2021-11-22 06:57:08,865 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname 2021-11-22 06:57:08,894 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: hostname -d 2021-11-22 06:57:09,410 | infra | DEBUG | MainThread | [remote_util:execute_command_raw_jsch:3307] Running command on 172.23.105.227: rm -f /opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-11-22T145257-ns_1@172.23.105.227.zip 2021-11-22 06:57:09,444 | infra | DEBUG | MainThread | [remote_util:disconnect:220] Disconnecting ssh_client for 172.23.105.227 2021-11-22 06:57:09,447 | test | WARNING | MainThread | [basetestcase:tearDownEverything:583] CLEANUP WAS SKIPPED 2021-11-22 06:57:09,447 | infra | INFO | MainThread | [basetestcase:tearDownEverything:626] ========== tasks in thread pool ========== 2021-11-22 06:57:09,448 | infra | INFO | MainThread | [basetestcase:tearDownEverything:628] ========================================== 2021-11-22 06:57:09,450 | infra | INFO | MainThread | [task_manager:shutdown:64] Running TaskManager shutdown 2021-11-22 06:57:09,450 | infra | INFO | MainThread | [task_manager:shutdown:64] Running TaskManager shutdown 2021-11-22 06:57:09,450 | infra | WARNING | MainThread | [cluster:shutdown:707] Cluster instance shutdown with force ERROR ====================================================================== ERROR: test_system_stability_with_indexer (storage.plasma.plasma_stats.PlasmaStatsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/storage/plasma/plasma_stats.py", line 19, in tearDown super(PlasmaStatsTest, self).tearDown() File "pytests/storage/storage_base.py", line 628, in tearDown super(StorageBase, self).tearDown() File "pytests/basetestcase.py", line 560, in tearDown self.assertFalse(result, msg="Cb_log file validation failed") AssertionError: Cb_log file validation failed ====================================================================== FAIL: test_system_stability_with_indexer (storage.plasma.plasma_stats.PlasmaStatsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/storage/plasma/plasma_stats.py", line 715, in test_system_stability_with_indexer self.assertTrue(rebalance_in_task_result, "Rebalance in task failed") AssertionError: Rebalance in task failed ---------------------------------------------------------------------- Ran 1 test in 28927.942s FAILED (failures=1, errors=1) During the test, Remote Connections: 71, Disconnections: 71 SDK Connections: 20, Disconnections: 20 summary so far suite storage.plasma.plasma_stats.PlasmaStatsTest , pass 0 , fail 1 failures so far... storage.plasma.plasma_stats.PlasmaStatsTest.test_system_stability_with_indexer testrunner logs, diags and results are available under /data/workspace/Sanjit_jython_temp/logs/testrunner-21-Nov-21_22-54-51/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 8h 3m 5s 2 actionable tasks: 2 executed Archiving artifacts Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE [description-setter] Description set: 7.1.0-1695 [BFA] Scanning build for known causes... [BFA] No failure causes found [BFA] Done. 0s Notifying upstream projects of job completion Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures) An attempt to send an e-mail to empty list of recipients, ignored. Finished: UNSTABLE