Started by user Balakumaran Gopal Rebuilds build #55 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on magma-sc1402-32g-24c (magma_slave) in workspace /data/workspace/temp_rebalance_magma_win [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is used... [WS-CLEANUP] Done No credentials specified Cloning the remote Git repository Cloning repository https://github.com/couchbaselabs/TAF/ > /usr/bin/git init /data/workspace/temp_rebalance_magma_win # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF/ > /usr/bin/git --version # timeout=10 > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF/ +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF/ # timeout=10 > /usr/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF/ # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF/ > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF/ +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git rev-parse refs/remotes/origin/master^{commit} # timeout=10 > /usr/bin/git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10 Checking out Revision e20d4cc5d97f8be77680d423dcdcf0bdf00f2dce (refs/remotes/origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 > /usr/bin/git checkout -f e20d4cc5d97f8be77680d423dcdcf0bdf00f2dce # timeout=10 Commit message: "Adding check to consider disk usage for all the checkpoints while doing space amp calculation in update and delete tests" > /usr/bin/git rev-list --no-walk e20d4cc5d97f8be77680d423dcdcf0bdf00f2dce # timeout=10 [temp_rebalance_magma_win] $ /bin/sh -xe /tmp/jenkins5541507155503592375.sh + echo '[global] username:Administrator password:Membase123 index_port:9102 n1ql_port:8093 port:8091 data_path:/data [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:172.23.136.156 #services:kv,index,n1ql,fts,eventing,cbas [_2] ip:172.23.136.160 #services:kv,index,n1ql,fts,eventing,cbas [_3] ip:172.23.136.162 #services:kv,index,n1ql,fts,eventing,cbas [_4] ip:172.23.136.158 #services:kv,index,n1ql,fts,eventing,cbas [_5] ip:172.23.136.154 #services:kv,index,n1ql,fts,eventing,cbas [_6] ip:172.23.136.152 #services:kv,index,n1ql,fts,eventing,cbas ' + git checkout master Switched to a new branch 'master' Branch master set up to track remote branch master from origin. + git pull origin master From https://github.com/couchbaselabs/TAF * branch master -> FETCH_HEAD Already up-to-date. + git clone https://github.com/sumedhpb/guides.git Cloning into 'guides'... + jython_path=/opt/jython/bin/jython + sdk_client_params='-P transaction_version=1.1.8 -P client_version=3.1.6' + mkdir tr_for_install + cd tr_for_install + git clone https://github.com/couchbase/testrunner.git Cloning into 'testrunner'... + cd testrunner + git checkout master Already on 'master' + git pull origin master From https://github.com/couchbase/testrunner * branch master -> FETCH_HEAD Already up-to-date. + py_executable=python + python3 scripts/new_install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p timeout=1200,get-cbcollect-info=True,version=7.1.0-2365,product=cb,debug_logs=False,url= 2022-02-23 01:53:32,175 - root - WARNING - URL: is not valid, will use version to locate build 2022-02-23 01:53:32,176 - root - INFO - SSH Connecting to 172.23.136.156 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:32,301 - root - INFO - SSH Connected to 172.23.136.156 as Administrator 2022-02-23 01:53:32,739 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:32,739 - root - INFO - This is windows server! 2022-02-23 01:53:32,835 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:32,924 - root - INFO - get windows information 2022-02-23 01:53:33,024 - root - INFO - running command.raw on 172.23.136.156: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:33,160 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:33,164 - root - INFO - SSH Connecting to 172.23.136.160 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:33,288 - root - INFO - SSH Connected to 172.23.136.160 as Administrator 2022-02-23 01:53:33,715 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:33,715 - root - INFO - This is windows server! 2022-02-23 01:53:33,817 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:33,901 - root - INFO - get windows information 2022-02-23 01:53:33,994 - root - INFO - running command.raw on 172.23.136.160: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:34,128 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:34,131 - root - INFO - SSH Connecting to 172.23.136.162 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:34,253 - root - INFO - SSH Connected to 172.23.136.162 as Administrator 2022-02-23 01:53:34,996 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:34,997 - root - INFO - This is windows server! 2022-02-23 01:53:35,097 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:35,186 - root - INFO - get windows information 2022-02-23 01:53:35,278 - root - INFO - running command.raw on 172.23.136.162: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:35,424 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:35,426 - root - INFO - SSH Connecting to 172.23.136.158 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:35,549 - root - INFO - SSH Connected to 172.23.136.158 as Administrator 2022-02-23 01:53:35,959 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:35,960 - root - INFO - This is windows server! 2022-02-23 01:53:36,054 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:36,140 - root - INFO - get windows information 2022-02-23 01:53:36,229 - root - INFO - running command.raw on 172.23.136.158: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:36,364 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:36,368 - root - INFO - SSH Connecting to 172.23.136.154 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:36,491 - root - INFO - SSH Connected to 172.23.136.154 as Administrator 2022-02-23 01:53:36,911 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:36,911 - root - INFO - This is windows server! 2022-02-23 01:53:37,012 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:37,102 - root - INFO - get windows information 2022-02-23 01:53:37,196 - root - INFO - running command.raw on 172.23.136.154: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:37,337 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:37,339 - root - INFO - SSH Connecting to 172.23.136.152 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:37,457 - root - INFO - SSH Connected to 172.23.136.152 as Administrator 2022-02-23 01:53:37,853 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:37,854 - root - INFO - This is windows server! 2022-02-23 01:53:37,946 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:38,027 - root - INFO - get windows information 2022-02-23 01:53:38,114 - root - INFO - running command.raw on 172.23.136.152: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:38,244 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:38,246 - root - INFO - SSH Connecting to 172.23.136.156 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:38,368 - root - INFO - SSH Connected to 172.23.136.156 as Administrator 2022-02-23 01:53:38,757 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:38,757 - root - INFO - This is windows server! 2022-02-23 01:53:38,857 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:38,947 - root - INFO - get windows information 2022-02-23 01:53:39,043 - root - INFO - running command.raw on 172.23.136.156: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:39,183 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:39,185 - root - INFO - SSH Connecting to 172.23.136.160 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:39,306 - root - INFO - SSH Connected to 172.23.136.160 as Administrator 2022-02-23 01:53:39,687 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:39,687 - root - INFO - This is windows server! 2022-02-23 01:53:39,784 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:39,872 - root - INFO - get windows information 2022-02-23 01:53:39,964 - root - INFO - running command.raw on 172.23.136.160: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:40,100 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:40,102 - root - INFO - SSH Connecting to 172.23.136.162 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:40,222 - root - INFO - SSH Connected to 172.23.136.162 as Administrator 2022-02-23 01:53:40,603 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:40,603 - root - INFO - This is windows server! 2022-02-23 01:53:40,705 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:40,793 - root - INFO - get windows information 2022-02-23 01:53:40,888 - root - INFO - running command.raw on 172.23.136.162: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:41,031 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:41,034 - root - INFO - SSH Connecting to 172.23.136.158 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:41,154 - root - INFO - SSH Connected to 172.23.136.158 as Administrator 2022-02-23 01:53:41,521 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:41,521 - root - INFO - This is windows server! 2022-02-23 01:53:41,619 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:41,710 - root - INFO - get windows information 2022-02-23 01:53:41,806 - root - INFO - running command.raw on 172.23.136.158: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:41,944 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:41,948 - root - INFO - SSH Connecting to 172.23.136.154 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:42,070 - root - INFO - SSH Connected to 172.23.136.154 as Administrator 2022-02-23 01:53:42,439 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:42,439 - root - INFO - This is windows server! 2022-02-23 01:53:42,539 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:42,626 - root - INFO - get windows information 2022-02-23 01:53:42,720 - root - INFO - running command.raw on 172.23.136.154: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:42,860 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:42,864 - root - INFO - SSH Connecting to 172.23.136.152 with username:Administrator, attempt#1 of 5 2022-02-23 01:53:42,980 - root - INFO - SSH Connected to 172.23.136.152 as Administrator 2022-02-23 01:53:43,325 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2022-02-23 01:53:43,325 - root - INFO - This is windows server! 2022-02-23 01:53:43,418 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2022-02-23 01:53:43,501 - root - INFO - get windows information 2022-02-23 01:53:43,590 - root - INFO - running command.raw on 172.23.136.152: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2022-02-23 01:53:43,718 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:43,719 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,734 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:43,734 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,736 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:43,737 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,738 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:43,738 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,740 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:43,740 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,741 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:43,742 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:53:43,743 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/2365/couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi is live 2022-02-23 01:53:52,541 - root - INFO - running command.raw on 172.23.136.152: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:52,635 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:52,635 - root - INFO - running command.raw on 172.23.136.152: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:52,733 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:52,734 - root - INFO - running command.raw on 172.23.136.152: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:53:52,901 - root - INFO - running command.raw on 172.23.136.158: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:52,905 - root - INFO - running command.raw on 172.23.136.154: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:52,961 - root - INFO - running command.raw on 172.23.136.156: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:53,000 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,000 - root - INFO - running command.raw on 172.23.136.158: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:53,002 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,002 - root - INFO - running command.raw on 172.23.136.154: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:53,062 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,062 - root - INFO - running command.raw on 172.23.136.156: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:53,104 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,105 - root - INFO - running command.raw on 172.23.136.158: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:53:53,108 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,108 - root - INFO - running command.raw on 172.23.136.154: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:53:53,119 - root - INFO - running command.raw on 172.23.136.160: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:53,166 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,166 - root - INFO - running command.raw on 172.23.136.156: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:53:53,219 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,219 - root - INFO - running command.raw on 172.23.136.160: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:53,224 - root - INFO - running command.raw on 172.23.136.162: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2022-02-23 01:53:53,324 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,324 - root - INFO - running command.raw on 172.23.136.162: cd /cygdrive/c/tmp/; ls *7.1.0-2365*.msi 2022-02-23 01:53:53,327 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,327 - root - INFO - running command.raw on 172.23.136.160: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:53:53,475 - root - INFO - command executed successfully with Administrator 2022-02-23 01:53:53,475 - root - INFO - running command.raw on 172.23.136.162: cd /cygdrive/c/tmp/; msiexec /x couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi /passive 2022-02-23 01:54:27,138 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:27,138 - root - INFO - running command.raw on 172.23.136.152: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:27,461 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:27,461 - root - INFO - running command.raw on 172.23.136.152: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:27,758 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:28,112 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:28,113 - root - INFO - running command.raw on 172.23.136.158: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:28,273 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:28,274 - root - INFO - running command.raw on 172.23.136.158: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:28,411 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:28,568 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:28,568 - root - INFO - running command.raw on 172.23.136.154: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:28,724 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:28,724 - root - INFO - running command.raw on 172.23.136.154: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:28,859 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:29,910 - root - INFO - Done with uninstall on 172.23.136.152. 2022-02-23 01:54:30,327 - root - INFO - Done with uninstall on 172.23.136.158. 2022-02-23 01:54:30,950 - root - INFO - Done with uninstall on 172.23.136.154. 2022-02-23 01:54:33,442 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:33,442 - root - INFO - running command.raw on 172.23.136.160: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:33,607 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:33,608 - root - INFO - running command.raw on 172.23.136.160: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:33,736 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:33,985 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:33,985 - root - INFO - running command.raw on 172.23.136.156: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:34,144 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:34,144 - root - INFO - running command.raw on 172.23.136.156: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:34,282 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:35,708 - root - INFO - Done with uninstall on 172.23.136.160. 2022-02-23 01:54:36,387 - root - INFO - Done with uninstall on 172.23.136.156. 2022-02-23 01:54:44,041 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:44,041 - root - INFO - running command.raw on 172.23.136.162: taskkill /F /IM MicrosoftEdge.exe /T 2022-02-23 01:54:44,230 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2022-02-23 01:54:44,231 - root - INFO - running command.raw on 172.23.136.162: taskkill /F /IM iexplore.exe /T 2022-02-23 01:54:44,367 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2022-02-23 01:54:46,475 - root - INFO - Done with uninstall on 172.23.136.162. 2022-02-23 01:54:49,105 - root - INFO - running command.raw on 172.23.136.156: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:49,198 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:49,574 - root - INFO - running command.raw on 172.23.136.160: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:49,699 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:50,278 - root - INFO - running command.raw on 172.23.136.162: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:50,429 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:50,833 - root - INFO - running command.raw on 172.23.136.158: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:50,966 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:51,351 - root - INFO - running command.raw on 172.23.136.154: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:51,475 - root - INFO - command executed successfully with Administrator 2022-02-23 01:54:51,844 - root - INFO - running command.raw on 172.23.136.152: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.1.0-2365-windows_amd64.msi 2022-02-23 01:54:51,976 - root - INFO - command executed successfully with Administrator 2022-02-23 01:57:31,555 - root - INFO - Done with install on 172.23.136.162. 2022-02-23 01:57:31,556 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:57:31,571 - root - INFO - running command.raw on 172.23.136.162: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.162 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:57:34,650 - root - INFO - command executed successfully with Administrator 2022-02-23 01:57:34,654 - root - INFO - running command.raw on 172.23.136.162: rm -rf /data/* 2022-02-23 01:57:34,744 - root - INFO - command executed successfully with Administrator 2022-02-23 01:57:34,745 - root - INFO - running command.raw on 172.23.136.162: chown -R couchbase:couchbase /data 2022-02-23 01:57:34,836 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:57:34,837 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:57:34,841 - root - ERROR - POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:57:34,844 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:57:35,849 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.162 2022-02-23 01:57:35,849 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:57:35,860 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:57:35,860 - root - INFO - /node/controller/setupServices params on 172.23.136.162: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:57:35,910 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:57:35,911 - root - INFO - settings/web params on 172.23.136.162:8091:port=8091&username=Administrator&password=password 2022-02-23 01:57:35,989 - root - INFO - --> status:True 2022-02-23 01:57:35,989 - root - INFO - Done with init on 172.23.136.162. 2022-02-23 01:57:36,631 - root - INFO - Done with cleanup on 172.23.136.162. 2022-02-23 01:58:02,022 - root - INFO - Done with install on 172.23.136.152. 2022-02-23 01:58:02,022 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:58:02,037 - root - INFO - running command.raw on 172.23.136.152: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.152 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:58:04,497 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:04,501 - root - INFO - running command.raw on 172.23.136.152: rm -rf /data/* 2022-02-23 01:58:04,586 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:04,587 - root - INFO - running command.raw on 172.23.136.152: chown -R couchbase:couchbase /data 2022-02-23 01:58:04,676 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:58:04,677 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:58:04,680 - root - ERROR - POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:58:04,680 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:58:04,824 - root - INFO - Done with install on 172.23.136.158. 2022-02-23 01:58:04,824 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:58:04,838 - root - INFO - running command.raw on 172.23.136.158: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.158 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:58:05,616 - root - INFO - Done with install on 172.23.136.160. 2022-02-23 01:58:05,616 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:58:05,632 - root - INFO - running command.raw on 172.23.136.160: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.160 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:58:05,633 - root - INFO - Done with install on 172.23.136.156. 2022-02-23 01:58:05,633 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:58:05,649 - root - INFO - running command.raw on 172.23.136.156: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.156 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:58:05,684 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.152 2022-02-23 01:58:05,684 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:58:05,697 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:58:05,697 - root - INFO - /node/controller/setupServices params on 172.23.136.152: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:58:05,735 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:58:05,736 - root - INFO - settings/web params on 172.23.136.152:8091:port=8091&username=Administrator&password=password 2022-02-23 01:58:05,820 - root - INFO - --> status:True 2022-02-23 01:58:05,820 - root - INFO - Done with init on 172.23.136.152. 2022-02-23 01:58:05,976 - root - INFO - Done with cleanup on 172.23.136.152. 2022-02-23 01:58:07,472 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:07,476 - root - INFO - running command.raw on 172.23.136.158: rm -rf /data/* 2022-02-23 01:58:07,568 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:07,568 - root - INFO - running command.raw on 172.23.136.158: chown -R couchbase:couchbase /data 2022-02-23 01:58:07,660 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:58:07,661 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:58:07,664 - root - ERROR - POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:58:07,665 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:58:08,232 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:08,236 - root - INFO - running command.raw on 172.23.136.160: rm -rf /data/* 2022-02-23 01:58:08,292 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:08,296 - root - INFO - running command.raw on 172.23.136.156: rm -rf /data/* 2022-02-23 01:58:08,325 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:08,325 - root - INFO - running command.raw on 172.23.136.160: chown -R couchbase:couchbase /data 2022-02-23 01:58:08,384 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:08,385 - root - INFO - running command.raw on 172.23.136.156: chown -R couchbase:couchbase /data 2022-02-23 01:58:08,417 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:58:08,418 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:58:08,421 - root - ERROR - POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:58:08,422 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:58:08,476 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:58:08,476 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:58:08,479 - root - ERROR - POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:58:08,479 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:58:08,669 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.158 2022-02-23 01:58:08,670 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:58:08,679 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:58:08,679 - root - INFO - /node/controller/setupServices params on 172.23.136.158: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:58:08,718 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:58:08,719 - root - INFO - settings/web params on 172.23.136.158:8091:port=8091&username=Administrator&password=password 2022-02-23 01:58:08,812 - root - INFO - --> status:True 2022-02-23 01:58:08,812 - root - INFO - Done with init on 172.23.136.158. 2022-02-23 01:58:08,979 - root - INFO - Done with cleanup on 172.23.136.158. 2022-02-23 01:58:09,426 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.160 2022-02-23 01:58:09,426 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:58:09,435 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:58:09,436 - root - INFO - /node/controller/setupServices params on 172.23.136.160: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:58:09,474 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:58:09,475 - root - INFO - settings/web params on 172.23.136.160:8091:port=8091&username=Administrator&password=password 2022-02-23 01:58:09,484 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.156 2022-02-23 01:58:09,484 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:58:09,498 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:58:09,498 - root - INFO - /node/controller/setupServices params on 172.23.136.156: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:58:09,537 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:58:09,537 - root - INFO - settings/web params on 172.23.136.156:8091:port=8091&username=Administrator&password=password 2022-02-23 01:58:09,570 - root - INFO - --> status:True 2022-02-23 01:58:09,571 - root - INFO - Done with init on 172.23.136.160. 2022-02-23 01:58:09,631 - root - INFO - --> status:True 2022-02-23 01:58:09,631 - root - INFO - Done with init on 172.23.136.156. 2022-02-23 01:58:09,745 - root - INFO - Done with cleanup on 172.23.136.160. 2022-02-23 01:58:09,805 - root - INFO - Done with cleanup on 172.23.136.156. 2022-02-23 01:58:12,283 - root - INFO - Done with install on 172.23.136.154. 2022-02-23 01:58:12,283 - root - INFO - Waiting for couchbase to be reachable 2022-02-23 01:58:12,298 - root - INFO - running command.raw on 172.23.136.154: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.136.154 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2022-02-23 01:58:14,919 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:14,924 - root - INFO - running command.raw on 172.23.136.154: rm -rf /data/* 2022-02-23 01:58:15,012 - root - INFO - command executed successfully with Administrator 2022-02-23 01:58:15,012 - root - INFO - running command.raw on 172.23.136.154: chown -R couchbase:couchbase /data 2022-02-23 01:58:15,103 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2022-02-23 01:58:15,104 - root - INFO - /nodes/self/controller/settings : path=%2Fdata 2022-02-23 01:58:15,108 - root - ERROR - POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2022-02-23 01:58:15,108 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2022-02-23 01:58:16,113 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.136.154 2022-02-23 01:58:16,113 - root - INFO - pools/default params : memoryQuota=3288 2022-02-23 01:58:16,127 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2022-02-23 01:58:16,127 - root - INFO - /node/controller/setupServices params on 172.23.136.154: 8091:hostname=None&user=Administrator&password=password&services=kv 2022-02-23 01:58:16,167 - root - INFO - --> in init_cluster...Administrator,password,8091 2022-02-23 01:58:16,167 - root - INFO - settings/web params on 172.23.136.154:8091:port=8091&username=Administrator&password=password 2022-02-23 01:58:16,251 - root - INFO - --> status:True 2022-02-23 01:58:16,251 - root - INFO - Done with init on 172.23.136.154. 2022-02-23 01:58:16,427 - root - INFO - Done with cleanup on 172.23.136.154. 2022-02-23 01:58:17,274 - root - INFO - ---------------------------------------------------------------------------------------------------- 2022-02-23 01:58:17,303 - root - INFO - cluster:C1 node:172.23.136.156:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - cluster:C2 node:172.23.136.160:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - cluster:C3 node:172.23.136.162:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - cluster:C4 node:172.23.136.158:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - cluster:C5 node:172.23.136.154:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - cluster:C6 node:172.23.136.152:8091 version:7.1.0-2365-enterprise aFamily:inet services:['kv'] 2022-02-23 01:58:17,303 - root - INFO - ---------------------------------------------------------------------------------------------------- 2022-02-23 01:58:17,304 - root - INFO - ---------------------------------------------------------------------------------------------------- 2022-02-23 01:58:17,304 - root - INFO - ---------------------------------------------------------------------------------------------------- 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.156 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.160 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.162 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.158 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.154 2022-02-23 01:58:17,304 - root - INFO - INSTALL COMPLETED ON: 172.23.136.152 2022-02-23 01:58:17,304 - root - INFO - ---------------------------------------------------------------------------------------------------- 2022-02-23 01:58:17,304 - root - INFO - TOTAL INSTALL TIME = 285 seconds + status=0 + cd ../.. + rm -rf tr_for_install + git fetch https://review.couchbase.org/TAF refs/changes/10/165810/2 From https://review.couchbase.org/TAF * branch refs/changes/10/165810/2 -> FETCH_HEAD + git cherry-pick FETCH_HEAD [master 2a4b3b8] CBQE-7196: Reduce the bucket size to match 90 dgm for windows tests Author: Balakumaran G Committer: root Your name and email address were configured automatically based on your username and hostname. Please check that they are accurate. You can suppress this message by setting them explicitly: git config --global user.name "Your Name" git config --global user.email you@example.com After doing this, you may fix the identity used for this commit with: git commit --amend --reset-author 2 files changed, 34 insertions(+), 1 deletion(-) create mode 100644 pytests/bucket_collections/bucket_templates/magma_dgm/1_percent_dgm/5_node_2_replica_magma_768_single_bucket.py + git fetch https://review.couchbase.org/TAF refs/changes/29/171129/2 From https://review.couchbase.org/TAF * branch refs/changes/29/171129/2 -> FETCH_HEAD + git cherry-pick FETCH_HEAD [master 587b49f] Updating bucket_util to use simple names based on prefix we set Author: Ashwin G Committer: root Your name and email address were configured automatically based on your username and hostname. Please check that they are accurate. You can suppress this message by setting them explicitly: git config --global user.name "Your Name" git config --global user.email you@example.com After doing this, you may fix the identity used for this commit with: git commit --amend --reset-author 3 files changed, 47 insertions(+), 19 deletions(-) + git fetch https://review.couchbase.org/TAF refs/changes/58/171158/1 From https://review.couchbase.org/TAF * branch refs/changes/58/171158/1 -> FETCH_HEAD + git cherry-pick FETCH_HEAD [master f5ab092] Fetch cbcollect when cleanup of the cluster fails due to rebalance Author: Balakumaran G Committer: root Your name and email address were configured automatically based on your username and hostname. Please check that they are accurate. You can suppress this message by setting them explicitly: git config --global user.name "Your Name" git config --global user.email you@example.com After doing this, you may fix the identity used for this commit with: git commit --amend --reset-author 1 file changed, 8 insertions(+), 4 deletions(-) + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' Starting a Gradle Daemon (subsequent builds will be faster) > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava warning: unknown enum constant When.MAYBE reason: class file for javax.annotation.meta.When not found Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 warning > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_01-58-40/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_01-58-40/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 01:58:44,858 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:58:45,220 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:58:45,845 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x2c0af19d, 0.0.0.0/0.0.0.0:43106] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0xf511d447, 0.0.0.0/0.0.0.0:51934] timeout=300.0>) 2022-02-23 01:59:03,421 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:03,421 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x191dedd4, 0.0.0.0/0.0.0.0:33432] timeout=300.0>) 2022-02-23 01:59:03,443 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0xe08f84ea, 0.0.0.0/0.0.0.0:49372] timeout=300.0>) 2022-02-23 01:59:03,461 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0xfc0980ce, 0.0.0.0/0.0.0.0:52821] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x5799a661, 0.0.0.0/0.0.0.0:59005] timeout=300.0>) 2022-02-23 01:59:03,479 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:03,480 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x1629715e, 0.0.0.0/0.0.0.0:57950] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x351760cc, 0.0.0.0/0.0.0.0:41935] timeout=300.0>) 2022-02-23 01:59:05,453 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:05,453 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0xb9363cb4, 0.0.0.0/0.0.0.0:35564] timeout=300.0>) 2022-02-23 01:59:05,460 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x7b3a57be, 0.0.0.0/0.0.0.0:43445] timeout=300.0>) 2022-02-23 01:59:05,473 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0x4d28b5be, 0.0.0.0/0.0.0.0:52508] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x6ccb13ca, 0.0.0.0/0.0.0.0:59032] timeout=300.0>) 2022-02-23 01:59:05,496 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:05,496 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0xc87c8567, 0.0.0.0/0.0.0.0:43723] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xbb7a0ba5, 0.0.0.0/0.0.0.0:45754] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x5c138c97, 0.0.0.0/0.0.0.0:37995] timeout=300.0>) 2022-02-23 01:59:07,473 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:07,473 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:07,473 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0xce7231db, 0.0.0.0/0.0.0.0:33434] timeout=300.0>) 2022-02-23 01:59:07,486 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x2f4d8378, 0.0.0.0/0.0.0.0:48238] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x8e4c796f, 0.0.0.0/0.0.0.0:52676] timeout=300.0>) 2022-02-23 01:59:07,513 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:07,513 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x7a77bed7, 0.0.0.0/0.0.0.0:39453] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x3e1dc773, 0.0.0.0/0.0.0.0:35486] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x53767e11, 0.0.0.0/0.0.0.0:43413] timeout=300.0>) 2022-02-23 01:59:09,496 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:09,496 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:09,496 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x5c82e9fe, 0.0.0.0/0.0.0.0:34951] timeout=300.0>) 2022-02-23 01:59:09,500 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xf9bbb7c2, 0.0.0.0/0.0.0.0:54516] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x58eefb40, 0.0.0.0/0.0.0.0:39265] timeout=300.0>) 2022-02-23 01:59:09,526 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:09,526 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x8d609fdb, 0.0.0.0/0.0.0.0:38756] timeout=300.0>) 2022-02-23 01:59:11,538 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 01:59:15,059 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:15,068 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:15,108 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 01:59:15,111 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 01:59:15,267 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:15,270 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:15,473 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:15,474 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:15,668 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:15,671 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:15,867 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:15,869 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:16,062 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 01:59:16,065 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 01:59:16,065 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 01:59:27,579 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 01:59:27,581 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:59:27,604 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:59:43,763 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.286666666667 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 01:59:43,798 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 01:59:58,864 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 01:59:58,887 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1260001659 sec 2022-02-23 01:59:59,055 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 1.69333333333 | 5.99 GiB | 4.12 GiB | 2.04 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 1.17001950033 | 5.99 GiB | 4.10 GiB | 2.06 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.26040797249 | 5.99 GiB | 4.15 GiB | 2.00 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 1.30166666667 | 5.99 GiB | 4.19 GiB | 1.94 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 01:59:59,055 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:59:59,056 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 01:59:59,358 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:00:49,595 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:00:50,400 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 268.12 MiB | 220.32 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 251.75 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 278.07 MiB | 181.68 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:00:50,401 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:01:01,990 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:01:02,016 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:01:17,453 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'default' +-------+------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ****....................................................................................................*X | 21473.300 | +-------+------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:01:17,477 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ****....................................................................................................*X | 150.000 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:01:18,723 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ****....................................................................................................**X | 147.800 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:01:20,059 | test | INFO | pool-3-thread-13 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 21473.300 | ...................................................................................................X | 21473.300 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:01:21,265 | test | INFO | pool-3-thread-30 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+-------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-------------------------------------------------------------------------------------------------------+---------+ | 150.000 | ...................................................................................................*X | 150.000 | +---------+-------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:01:21,285 | test | INFO | pool-3-thread-3 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+-------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-------------------------------------------------------------------------------------------------------+---------+ | 147.800 | ...................................................................................................*X | 147.800 | +---------+-------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:01:21,653 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 61.2306418219 | 5.99 GiB | 3.67 GiB | 2.58 GiB / 7.62 GiB | 53938 / 154152 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 62.0818701881 | 5.99 GiB | 3.63 GiB | 2.62 GiB / 7.62 GiB | 54762 / 157754 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 73.7872667179 | 5.99 GiB | 3.60 GiB | 2.64 GiB / 7.62 GiB | 54170 / 154597 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 61.1627095552 | 5.99 GiB | 3.66 GiB | 2.61 GiB / 7.62 GiB | 54589 / 160062 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:01:25,624 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:02:12,346 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 188.82 MiB | 398.22 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.88 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 537.56 MiB | 430.88 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:02:12,348 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:02:18,588 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:02:19,012 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:02:19,013 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:02:19,019 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:02:24,648 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:02:24,786 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:02:43,171 | test | INFO | pool-3-thread-27 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 99.5333177773 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.261662305628 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 100 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:02:43,482 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:02:44,782 | test | INFO | pool-3-thread-12 | [table_view:display:72] Ops trend for bucket 'default' +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | *............**........................................*................................................X | 21792.000 | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:02:45,546 | test | INFO | pool-3-thread-6 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *........*............................................................................................X | 6291.400 | | 174.000 | .*X | 186.600 | +---------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:02:46,512 | test | INFO | pool-3-thread-7 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *...............**.....................................................................................X | 4214.400 | | 1118.400 | .........................X | 1118.400 | | 101.000 | .X | 101.000 | +----------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:02:47,841 | test | INFO | pool-3-thread-29 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 18132.600 | ...................................................................................................X | 18132.600 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:02:47,862 | test | INFO | pool-3-thread-11 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 113.133 | ...................................................................................................X | 113.133 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:02:47,888 | test | INFO | pool-3-thread-15 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 101.000 | ...................................................................................................X | 101.000 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:02:53,530 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:03:03,601 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 16.21 2022-02-23 02:03:13,665 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:03:23,711 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 33.75 2022-02-23 02:03:33,766 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 61.15 2022-02-23 02:03:43,815 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:03:53,931 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 78.32 2022-02-23 02:04:04,230 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:04:14,276 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:04:29,338 | test | INFO | pool-3-thread-27 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:04:29,431 | test | INFO | pool-3-thread-27 | [task:check:474] Rebalance completed with progress: 100% in 106.260999918 sec 2022-02-23 02:04:29,664 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:04:33,418 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:05:14,469 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 32044 | 800.00 MiB | 286.04 MiB | 229.15 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 37030 | 800.00 MiB | 368.37 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 377912 | 5.86 GiB | 684.95 MiB | 489.86 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:05:14,470 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:05:15,197 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:05:15,664 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:05:15,665 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:05:26,398 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:05:26,398 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:05:43,384 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:05:43,385 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 454.908s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_01-58-40/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 55s 2 actionable tasks: 2 executed + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-06-30/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-06-30/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:06:34,015 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:06:34,480 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:06:54,612 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6840000153 seconds to complete 2022-02-23 02:06:54,635 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:06:59,915 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x0a3fd389, 0.0.0.0/0.0.0.0:41719] timeout=300.0>) 2022-02-23 02:07:16,821 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x703fb828, 0.0.0.0/0.0.0.0:52912] timeout=300.0>) 2022-02-23 02:07:16,852 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0xcfe2ffe0, 0.0.0.0/0.0.0.0:58701] timeout=300.0>) 2022-02-23 02:07:16,868 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x712c8b13, 0.0.0.0/0.0.0.0:46660] timeout=300.0>) 2022-02-23 02:07:16,880 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x39e19c80, 0.0.0.0/0.0.0.0:43334] timeout=300.0>) 2022-02-23 02:07:16,911 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0xdd9177fd, 0.0.0.0/0.0.0.0:54908] timeout=300.0>) 2022-02-23 02:07:16,933 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0xc26f0a02, 0.0.0.0/0.0.0.0:34724] timeout=300.0>) 2022-02-23 02:07:18,842 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0xc6482a47, 0.0.0.0/0.0.0.0:34214] timeout=300.0>) 2022-02-23 02:07:18,874 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x7003b64b, 0.0.0.0/0.0.0.0:34831] timeout=300.0>) 2022-02-23 02:07:18,885 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x3fd7191a, 0.0.0.0/0.0.0.0:43090] timeout=300.0>) 2022-02-23 02:07:18,894 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0x63eaffc8, 0.0.0.0/0.0.0.0:33640] timeout=300.0>) 2022-02-23 02:07:18,926 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0xf957b5da, 0.0.0.0/0.0.0.0:56769] timeout=300.0>) 2022-02-23 02:07:18,950 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x60e944f8, 0.0.0.0/0.0.0.0:55758] timeout=300.0>) 2022-02-23 02:07:20,855 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0x8c9d7b69, 0.0.0.0/0.0.0.0:58788] timeout=300.0>) 2022-02-23 02:07:20,887 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x0c3c4bc2, 0.0.0.0/0.0.0.0:46260] timeout=300.0>) 2022-02-23 02:07:20,901 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x516db4bc, 0.0.0.0/0.0.0.0:39201] timeout=300.0>) 2022-02-23 02:07:20,911 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x343ee960, 0.0.0.0/0.0.0.0:42867] timeout=300.0>) 2022-02-23 02:07:20,941 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0xcfd918d9, 0.0.0.0/0.0.0.0:51885] timeout=300.0>) 2022-02-23 02:07:20,966 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0xfa339dac, 0.0.0.0/0.0.0.0:41573] timeout=300.0>) 2022-02-23 02:07:22,875 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x12ae3255, 0.0.0.0/0.0.0.0:49922] timeout=300.0>) 2022-02-23 02:07:22,898 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x8b2a8347, 0.0.0.0/0.0.0.0:58303] timeout=300.0>) 2022-02-23 02:07:22,915 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x3c06aa30, 0.0.0.0/0.0.0.0:44539] timeout=300.0>) 2022-02-23 02:07:22,926 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0x863b5d62, 0.0.0.0/0.0.0.0:40504] timeout=300.0>) 2022-02-23 02:07:22,953 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x070df061, 0.0.0.0/0.0.0.0:34759] timeout=300.0>) 2022-02-23 02:07:22,976 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0xb38e4f5e, 0.0.0.0/0.0.0.0:47878] timeout=300.0>) 2022-02-23 02:07:24,911 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x432b4b80, 0.0.0.0/0.0.0.0:34558] timeout=300.0>) 2022-02-23 02:07:24,967 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:07:28,496 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:28,500 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:28,548 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:07:28,549 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:07:28,773 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:28,776 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:28,990 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:28,993 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:29,203 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:29,207 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:29,496 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:29,509 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:29,720 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:07:29,727 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:07:29,729 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:07:41,319 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:07:41,319 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:07:41,352 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:07:53,295 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+--------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+--------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 1.0949817503 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+--------------+--------------+ 2022-02-23 02:07:53,328 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:08:08,392 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:08:08,414 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.120000124 sec 2022-02-23 02:08:08,607 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 0.91 | 5.99 GiB | 4.18 GiB | 1.96 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 2.00814609555 | 5.99 GiB | 4.13 GiB | 2.03 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.991553433713 | 5.99 GiB | 4.16 GiB | 1.98 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.233333333333 | 5.99 GiB | 4.18 GiB | 1.97 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:08:08,608 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:08:08,609 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:08:08,882 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:08:57,782 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:08:58,569 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 237.08 MiB | 256.55 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 258.10 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 241.23 MiB | 229.24 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:08:58,571 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:09:10,769 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:09:10,796 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:09:28,224 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ****....................................................................................................**X | 184.500 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:09:29,164 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ****....................................................................................................**X | 23053.400 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:09:30,335 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+--------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+--------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ****....................................................................................................***X | 161.200 | +-------+--------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:09:31,752 | test | INFO | pool-3-thread-16 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 184.500 | ...................................................................................................X | 184.500 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:09:31,773 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 23053.400 | ...................................................................................................X | 23053.400 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:09:31,803 | test | INFO | pool-3-thread-12 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 161.200 | ...................................................................................................X | 161.200 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:09:32,167 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 87.3960150275 | 5.99 GiB | 3.67 GiB | 2.56 GiB / 7.62 GiB | 58376 / 174860 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 99.2134171908 | 5.99 GiB | 3.63 GiB | 2.61 GiB / 7.62 GiB | 96800 / 289200 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 66.0431989883 | 5.99 GiB | 3.65 GiB | 2.59 GiB / 7.62 GiB | 58602 / 173154 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 98.4067008844 | 5.99 GiB | 3.65 GiB | 2.61 GiB / 7.62 GiB | 58340 / 173904 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:09:36,352 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:10:23,338 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.31 MiB | 457.98 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.86 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 536.78 MiB | 423.09 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:10:23,339 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:10:29,407 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:10:29,848 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:10:29,849 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:10:29,854 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:10:36,135 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:10:36,302 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:10:56,605 | test | INFO | pool-3-thread-14 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 95.0463987319 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 95.4166666667 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.156666666667 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 90.7559395248 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.441666666667 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 85.1613483955 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:10:56,733 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:10:57,279 | test | INFO | pool-3-thread-8 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +--------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................*X | 6036.000 | | 59.000 | *.X | 67.200 | +--------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:10:57,750 | test | INFO | pool-3-thread-28 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ***........................................................*.........................**...................X | 18174.600 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:10:59,263 | test | INFO | pool-3-thread-15 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................*X | 6973.600 | | 1192.400 | ................X | 1192.400 | | 104.000 | *X | 104.000 | +----------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:11:00,673 | test | INFO | pool-3-thread-20 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 35.800 | ...................................................................................................X | 35.800 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:11:00,697 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 11484.600 | ...................................................................................................X | 11484.600 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:11:00,726 | test | INFO | pool-3-thread-5 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 57.600 | ...................................................................................................X | 57.600 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:11:07,051 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 6.12 2022-02-23 02:11:17,164 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 16.93 2022-02-23 02:11:27,220 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:11:37,275 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 34.24 2022-02-23 02:11:47,323 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 62.07 2022-02-23 02:11:57,378 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:12:07,444 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 78.12 2022-02-23 02:12:17,493 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 94.44 2022-02-23 02:12:27,542 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:12:42,605 | test | INFO | pool-3-thread-14 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:12:42,709 | test | INFO | pool-3-thread-14 | [task:check:474] Rebalance completed with progress: 100% in 106.105000019 sec 2022-02-23 02:12:42,948 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:12:46,674 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:13:28,301 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 42548 | 800.00 MiB | 311.04 MiB | 235.17 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 31540 | 800.00 MiB | 367.55 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 374736 | 5.86 GiB | 669.09 MiB | 481.43 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:13:28,301 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:13:29,032 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:13:29,505 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:13:29,506 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:13:37,936 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:13:37,937 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:14:02,345 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:14:02,348 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok During the test, ---------------------------------------------------------------------- Ran 1 test in 480.083s Remote Connections: 193, Disconnections: 193 OK SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-06-30/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 8m 13s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-14-43/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-14-43/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:14:47,859 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:14:48,359 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:15:10,497 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6900000572 seconds to complete 2022-02-23 02:15:10,522 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:15:15,770 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x4fc109ac, 0.0.0.0/0.0.0.0:51768] timeout=300.0>) 2022-02-23 02:15:32,809 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0xa36edc4f, 0.0.0.0/0.0.0.0:40023] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x4088ad7a, 0.0.0.0/0.0.0.0:46855] timeout=300.0>) 2022-02-23 02:15:32,849 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:15:32,851 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0xb735c26a, 0.0.0.0/0.0.0.0:49928] timeout=300.0>) 2022-02-23 02:15:32,907 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x808ae7ec, 0.0.0.0/0.0.0.0:51470] timeout=300.0>) 2022-02-23 02:15:34,829 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x54fe8b78, 0.0.0.0/0.0.0.0:35527] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x8ef40e99, 0.0.0.0/0.0.0.0:47212] timeout=300.0>) 2022-02-23 02:15:34,875 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:15:34,875 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0xeae920d9, 0.0.0.0/0.0.0.0:57690] timeout=300.0>) 2022-02-23 02:15:34,921 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x3cc86997, 0.0.0.0/0.0.0.0:47779] timeout=300.0>) 2022-02-23 02:15:35,214 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x1116a2f1, 0.0.0.0/0.0.0.0:36813] timeout=300.0>) 2022-02-23 02:15:35,298 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0x618ebe43, 0.0.0.0/0.0.0.0:55261] timeout=300.0>) 2022-02-23 02:15:36,845 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x1890aab3, 0.0.0.0/0.0.0.0:45278] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0xdd0a64f8, 0.0.0.0/0.0.0.0:32811] timeout=300.0>) 2022-02-23 02:15:36,894 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:15:36,894 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xb7a3cc46, 0.0.0.0/0.0.0.0:46065] timeout=300.0>) 2022-02-23 02:15:36,937 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x61f29f46, 0.0.0.0/0.0.0.0:38310] timeout=300.0>) 2022-02-23 02:15:37,227 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x905ec6b8, 0.0.0.0/0.0.0.0:55027] timeout=300.0>) 2022-02-23 02:15:37,311 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x61c26391, 0.0.0.0/0.0.0.0:45278] timeout=300.0>) 2022-02-23 02:15:38,864 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x170b8a52, 0.0.0.0/0.0.0.0:49174] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0xaaddb0c4, 0.0.0.0/0.0.0.0:36140] timeout=300.0>) 2022-02-23 02:15:38,910 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:15:38,911 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x307e2973, 0.0.0.0/0.0.0.0:40919] timeout=300.0>) 2022-02-23 02:15:38,948 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x45b1420e, 0.0.0.0/0.0.0.0:60143] timeout=300.0>) 2022-02-23 02:15:39,246 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0xd313d407, 0.0.0.0/0.0.0.0:43868] timeout=300.0>) 2022-02-23 02:15:39,325 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0x627ff529, 0.0.0.0/0.0.0.0:60591] timeout=300.0>) 2022-02-23 02:15:40,927 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x3adfcddb, 0.0.0.0/0.0.0.0:49630] timeout=300.0>) 2022-02-23 02:15:40,961 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x5d78bd2f, 0.0.0.0/0.0.0.0:44809] timeout=300.0>) 2022-02-23 02:15:41,259 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x477f1542, 0.0.0.0/0.0.0.0:49934] timeout=300.0>) 2022-02-23 02:15:41,338 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0x159b7c25, 0.0.0.0/0.0.0.0:57424] timeout=300.0>) 2022-02-23 02:15:43,351 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:15:47,404 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:47,408 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:47,459 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:15:47,461 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:15:47,674 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:47,678 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:47,885 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:47,888 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:48,094 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:48,096 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:48,305 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:48,309 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:48,517 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:15:48,522 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:15:48,523 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:16:00,092 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:16:00,092 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:16:00,125 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:16:12,398 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+-------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+-------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.625 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+-------+--------------+ 2022-02-23 02:16:12,430 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:16:27,496 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:16:27,516 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1199998856 sec 2022-02-23 02:16:27,687 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 1.51401338742 | 5.99 GiB | 4.14 GiB | 2.03 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 1.32833333333 | 5.99 GiB | 4.12 GiB | 2.03 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.52 | 5.99 GiB | 4.16 GiB | 1.98 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.809588195036 | 5.99 GiB | 4.18 GiB | 1.98 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:16:27,688 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:16:27,690 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:16:28,005 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:17:16,305 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:17:17,160 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 245.77 MiB | 293.15 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 264.49 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 246.79 MiB | 232.45 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:17:17,161 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:17:28,125 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:17:28,148 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:17:45,828 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | **..........................***..........................................................................*X | 196.500 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:17:46,612 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | *.........****...........................................................................................*X | 27552.500 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:17:47,364 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+--------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+--------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | *.........................****...........................................................................**X | 201.000 | +-------+--------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:17:48,749 | test | INFO | pool-3-thread-6 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 196.500 | ...................................................................................................X | 196.500 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:17:48,803 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 27552.500 | ...................................................................................................X | 27552.500 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:17:50,032 | test | INFO | pool-3-thread-4 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+-------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-------------------------------------------------------------------------------------------------------+---------+ | 201.000 | ...................................................................................................*X | 201.000 | +---------+-------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:17:50,401 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 95.3601406722 | 5.99 GiB | 3.66 GiB | 2.59 GiB / 7.62 GiB | 75931 / 229047 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 92.6566666667 | 5.99 GiB | 3.63 GiB | 2.62 GiB / 7.62 GiB | 76630 / 228953 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 93.1766666667 | 5.99 GiB | 3.65 GiB | 2.62 GiB / 7.62 GiB | 76607 / 227646 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 95.0156177311 | 5.99 GiB | 3.67 GiB | 2.58 GiB / 7.62 GiB | 76269 / 226971 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:17:54,447 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:18:41,437 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.28 MiB | 455.63 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.87 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 545.10 MiB | 431.38 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:18:41,440 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:18:47,440 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:18:47,857 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:18:47,858 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:18:47,861 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:18:53,888 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:18:54,036 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:19:10,174 | test | INFO | pool-3-thread-3 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 94.7026857092 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.286666666667 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 99.2630728851 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.285004750079 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 100 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:19:10,293 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:19:12,167 | test | INFO | pool-3-thread-11 | [table_view:display:72] Ops trend for bucket 'bucket2' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *....................................................................................................*X | 3783.200 | | 2388.600 | ..............................................................X | 2388.600 | | 124.400 | ..X | 124.400 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:19:13,463 | test | INFO | pool-3-thread-18 | [table_view:display:72] Ops trend for bucket 'default' +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **.......................*.............................................................................*X | 17875.200 | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:19:14,724 | test | INFO | pool-3-thread-10 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +--------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *....................................................................................................*X | 2550.000 | | 96.200 | ..*X | 96.200 | | 32.200 | X | 32.200 | +--------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:19:16,655 | test | INFO | pool-3-thread-20 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 29.600 | ...................................................................................................X | 29.600 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:19:18,229 | test | INFO | pool-3-thread-30 | [table_view:display:72] Ops trend for bucket 'default' +----------+-------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-------------------------------------------------------------------------------------------------------+----------+ | 7237.800 | ...................................................................................................*X | 7237.800 | +----------+-------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:19:18,448 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+-------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+-------------------------------------------------------------------------------------------------------+--------+ | 32.200 | ...................................................................................................*X | 32.200 | +--------+-------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:19:20,700 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 5.73 2022-02-23 02:19:30,989 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 27.78 2022-02-23 02:19:41,029 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:19:52,289 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 46.16 2022-02-23 02:20:02,338 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:20:12,388 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 67.27 2022-02-23 02:20:22,996 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 87.67 2022-02-23 02:20:33,049 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:20:48,112 | test | INFO | pool-3-thread-3 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:20:48,211 | test | INFO | pool-3-thread-3 | [task:check:474] Rebalance completed with progress: 100% in 98.0379998684 sec 2022-02-23 02:20:48,464 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:20:52,046 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:21:31,990 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 37058 | 800.00 MiB | 295.38 MiB | 214.52 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 32534 | 800.00 MiB | 382.35 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 310424 | 5.86 GiB | 591.10 MiB | 461.11 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:21:31,992 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:21:32,720 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:21:33,190 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:21:33,190 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:21:45,947 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:21:45,947 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:22:00,681 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:22:00,683 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 467.079s OK During the test, Remote Connections: 193, Disconnections: 192 SDK Connections: 30, Disconnections: 30 !!!!!! CRITICAL :: Shell disconnection mismatch !!!!! summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-14-43/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 8m 0s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-22-44/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-22-44/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:22:47,823 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:22:48,270 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:23:07,542 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6650002003 seconds to complete 2022-02-23 02:23:07,562 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:23:12,773 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0xfa116f0d, 0.0.0.0/0.0.0.0:44244] timeout=300.0>) 2022-02-23 02:23:29,642 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x9f13a197, 0.0.0.0/0.0.0.0:53522] timeout=300.0>) 2022-02-23 02:23:29,674 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x5ee7eae3, 0.0.0.0/0.0.0.0:42910] timeout=300.0>) 2022-02-23 02:23:29,687 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x8b5b9236, 0.0.0.0/0.0.0.0:35117] timeout=300.0>) 2022-02-23 02:23:29,711 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x504f4f72, 0.0.0.0/0.0.0.0:41162] timeout=300.0>) 2022-02-23 02:23:29,756 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x5b65d9ef, 0.0.0.0/0.0.0.0:53662] timeout=300.0>) 2022-02-23 02:23:29,773 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0xfc7bd7e3, 0.0.0.0/0.0.0.0:48849] timeout=300.0>) 2022-02-23 02:23:31,660 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x5a9719ba, 0.0.0.0/0.0.0.0:58799] timeout=300.0>) 2022-02-23 02:23:31,694 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x9659917e, 0.0.0.0/0.0.0.0:49790] timeout=300.0>) 2022-02-23 02:23:31,700 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x27427282, 0.0.0.0/0.0.0.0:55274] timeout=300.0>) 2022-02-23 02:23:31,726 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xe3962b41, 0.0.0.0/0.0.0.0:54371] timeout=300.0>) 2022-02-23 02:23:31,776 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x178e9a73, 0.0.0.0/0.0.0.0:39285] timeout=300.0>) 2022-02-23 02:23:31,788 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x4a37a5b6, 0.0.0.0/0.0.0.0:35981] timeout=300.0>) 2022-02-23 02:23:33,673 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0x5d3c4ffc, 0.0.0.0/0.0.0.0:47655] timeout=300.0>) 2022-02-23 02:23:33,709 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x24194c41, 0.0.0.0/0.0.0.0:35593] timeout=300.0>) 2022-02-23 02:23:33,713 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x42bc6f0f, 0.0.0.0/0.0.0.0:33022] timeout=300.0>) 2022-02-23 02:23:33,743 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x650c7231, 0.0.0.0/0.0.0.0:57456] timeout=300.0>) 2022-02-23 02:23:33,792 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x45381d7f, 0.0.0.0/0.0.0.0:36833] timeout=300.0>) 2022-02-23 02:23:33,798 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x01edcf27, 0.0.0.0/0.0.0.0:34736] timeout=300.0>) 2022-02-23 02:23:35,684 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x6d28df1d, 0.0.0.0/0.0.0.0:54048] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x293a01a0, 0.0.0.0/0.0.0.0:50777] timeout=300.0>) 2022-02-23 02:23:35,723 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:23:35,723 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x34f5cfb2, 0.0.0.0/0.0.0.0:44075] timeout=300.0>) 2022-02-23 02:23:35,755 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0x4f0000e2, 0.0.0.0/0.0.0.0:52551] timeout=300.0>) 2022-02-23 02:23:35,805 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0xca8beb8c, 0.0.0.0/0.0.0.0:35356] timeout=300.0>) 2022-02-23 02:23:35,809 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0xb9f03649, 0.0.0.0/0.0.0.0:39791] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0xc09831c1, 0.0.0.0/0.0.0.0:34032] timeout=300.0>) 2022-02-23 02:23:37,740 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:23:37,740 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0x881b7ae6, 0.0.0.0/0.0.0.0:58909] timeout=300.0>) 2022-02-23 02:23:37,766 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x26 type=client open_count=1 channel=[id: 0x5d884865, 0.0.0.0/0.0.0.0:36135] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x27 type=client open_count=1 channel=[id: 0x6481b1c5, 0.0.0.0/0.0.0.0:34059] timeout=300.0>) 2022-02-23 02:23:37,823 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:23:37,823 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:23:41,471 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:41,474 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:41,517 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:23:41,522 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:23:41,680 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:41,684 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:41,898 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:41,903 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:42,111 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:42,114 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:42,375 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:42,378 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:42,578 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:23:42,581 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:23:42,582 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:23:54,125 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:23:54,125 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:23:54,154 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:24:07,168 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.728333333333 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:24:07,197 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:24:22,253 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:24:22,273 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1050000191 sec 2022-02-23 02:24:22,454 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 0 | 0.0 Byte | 0.0 Byte | 0.0 Byte / 0.0 Byte | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 2.81333333333 | 5.99 GiB | 4.09 GiB | 2.06 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.366660555657 | 5.99 GiB | 4.11 GiB | 2.04 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.312155710613 | 5.99 GiB | 4.18 GiB | 1.97 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:24:22,456 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:24:22,457 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:24:22,740 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:25:12,927 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:25:13,704 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 261.17 MiB | 231.10 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 249.27 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 272.74 MiB | 174.39 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:25:13,706 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:25:24,186 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:25:24,214 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:25:39,644 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................**X | 138.400 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:25:40,341 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................***X | 147.800 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:25:41,463 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'default' +-------+--------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+--------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ***....................................................................................................****X | 13982.100 | +-------+--------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:25:42,828 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 161.600 | ...................................................................................................X | 161.600 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:25:42,844 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 152.200 | ...................................................................................................X | 152.200 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:25:42,865 | test | INFO | pool-3-thread-29 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 24017.900 | ...................................................................................................X | 24017.900 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:25:43,178 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 98.5143391313 | 5.99 GiB | 3.64 GiB | 2.61 GiB / 7.62 GiB | 34988 / 99083 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 98.9249475891 | 5.99 GiB | 3.60 GiB | 2.63 GiB / 7.62 GiB | 36039 / 100931 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 41.6530768463 | 5.99 GiB | 3.66 GiB | 2.58 GiB / 7.62 GiB | 35342 / 98496 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 39.5204100311 | 5.99 GiB | 3.72 GiB | 2.55 GiB / 7.62 GiB | 35552 / 98764 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:25:46,994 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:26:33,308 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.09 MiB | 407.56 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.85 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 540.30 MiB | 445.27 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:26:33,309 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:26:39,358 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:26:39,766 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:26:39,767 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:26:39,772 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:26:46,164 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:26:46,325 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:27:02,946 | test | INFO | pool-3-thread-12 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 88.8536321901 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 91.8425671722 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.26 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 90.1342460291 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.314994750087 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 95.6281274691 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:27:03,177 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:27:05,046 | test | INFO | pool-3-thread-6 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................*X | 3031.200 | | 2987.800 | .................................................................................................X | 2987.800 | +----------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:27:06,618 | test | INFO | pool-3-thread-14 | [table_view:display:72] Ops trend for bucket 'bucket2' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 6599.600 | | 1564.200 | ......................X | 1564.200 | | 165.600 | .X | 165.600 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:27:06,996 | test | INFO | pool-3-thread-21 | [table_view:display:72] Ops trend for bucket 'default' +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **................................................................................X | 13753.200 | | 13383.000 | .............................................................................*......................X | 17029.400 | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:27:08,453 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 249.200 | ...................................................................................................X | 249.200 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:27:08,476 | test | INFO | pool-3-thread-2 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 165.600 | ...................................................................................................X | 165.600 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:27:08,553 | test | INFO | pool-3-thread-5 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 17029.400 | ...................................................................................................X | 17029.400 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:27:13,282 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 9.98 2022-02-23 02:27:23,625 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 31.68 2022-02-23 02:27:33,671 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:27:44,637 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 52.11 2022-02-23 02:27:54,684 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:28:04,757 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 72.27 2022-02-23 02:28:14,834 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 87.04 2022-02-23 02:28:24,880 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:28:39,937 | test | INFO | pool-3-thread-12 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:28:41,273 | test | INFO | pool-3-thread-12 | [task:check:474] Rebalance completed with progress: 100% in 98.3289999962 sec 2022-02-23 02:28:41,536 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:28:45,210 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:29:25,467 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 32086 | 800.00 MiB | 288.15 MiB | 303.45 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 42562 | 800.00 MiB | 393.39 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 299952 | 5.86 GiB | 586.18 MiB | 441.35 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:29:25,467 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:29:26,180 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:29:26,648 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:29:26,648 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:29:39,684 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:29:39,684 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:29:58,336 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:29:58,338 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 459.874s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-22-44/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 52s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-30-36/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-30-36/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:30:40,187 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:30:40,637 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:31:00,572 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6610000134 seconds to complete 2022-02-23 02:31:00,592 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:31:05,859 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x95391ef8, 0.0.0.0/0.0.0.0:55974] timeout=300.0>) 2022-02-23 02:31:22,756 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x4b79aca0, 0.0.0.0/0.0.0.0:38878] timeout=300.0>) 2022-02-23 02:31:22,765 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x6e1d0bbf, 0.0.0.0/0.0.0.0:53459] timeout=300.0>) 2022-02-23 02:31:22,841 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x13f9a883, 0.0.0.0/0.0.0.0:47429] timeout=300.0>) 2022-02-23 02:31:22,947 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x66974605, 0.0.0.0/0.0.0.0:55173] timeout=300.0>) 2022-02-23 02:31:23,026 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x39ce6453, 0.0.0.0/0.0.0.0:44805] timeout=300.0>) 2022-02-23 02:31:24,776 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0xcc806e7f, 0.0.0.0/0.0.0.0:47429] timeout=300.0>) 2022-02-23 02:31:24,783 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x78ba118a, 0.0.0.0/0.0.0.0:40799] timeout=300.0>) 2022-02-23 02:31:24,858 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0xb59008d5, 0.0.0.0/0.0.0.0:42116] timeout=300.0>) 2022-02-23 02:31:24,963 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0xfc958559, 0.0.0.0/0.0.0.0:46790] timeout=300.0>) 2022-02-23 02:31:25,042 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xc8c3b49e, 0.0.0.0/0.0.0.0:49930] timeout=300.0>) 2022-02-23 02:31:25,269 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0xd7ba3d6a, 0.0.0.0/0.0.0.0:40297] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x00db08c2, 0.0.0.0/0.0.0.0:34497] timeout=300.0>) 2022-02-23 02:31:26,799 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:31:26,799 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xc6c2e9a6, 0.0.0.0/0.0.0.0:39768] timeout=300.0>) 2022-02-23 02:31:26,875 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x58dbaab5, 0.0.0.0/0.0.0.0:54879] timeout=300.0>) 2022-02-23 02:31:26,977 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0xf045a81e, 0.0.0.0/0.0.0.0:56628] timeout=300.0>) 2022-02-23 02:31:27,059 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0xc3f9a2e9, 0.0.0.0/0.0.0.0:50557] timeout=300.0>) 2022-02-23 02:31:27,282 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x433265ed, 0.0.0.0/0.0.0.0:40595] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x91981040, 0.0.0.0/0.0.0.0:33860] timeout=300.0>) 2022-02-23 02:31:28,819 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:31:28,819 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x57a33d80, 0.0.0.0/0.0.0.0:57537] timeout=300.0>) 2022-02-23 02:31:28,888 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x12299860, 0.0.0.0/0.0.0.0:42424] timeout=300.0>) 2022-02-23 02:31:28,990 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0xbad5592d, 0.0.0.0/0.0.0.0:48354] timeout=300.0>) 2022-02-23 02:31:29,069 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xbc2bb9a7, 0.0.0.0/0.0.0.0:36848] timeout=300.0>) 2022-02-23 02:31:29,293 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x7f07ebac, 0.0.0.0/0.0.0.0:56837] timeout=300.0>) 2022-02-23 02:31:30,835 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x9b8b803e, 0.0.0.0/0.0.0.0:48705] timeout=300.0>) 2022-02-23 02:31:30,901 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x3f0f92f8, 0.0.0.0/0.0.0.0:47793] timeout=300.0>) 2022-02-23 02:31:31,003 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0x4fcf15a2, 0.0.0.0/0.0.0.0:56235] timeout=300.0>) 2022-02-23 02:31:31,082 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x26 type=client open_count=1 channel=[id: 0x4d943d71, 0.0.0.0/0.0.0.0:39923] timeout=300.0>) 2022-02-23 02:31:31,306 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x27 type=client open_count=1 channel=[id: 0x9d7ae3c8, 0.0.0.0/0.0.0.0:59434] timeout=300.0>) 2022-02-23 02:31:33,319 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:31:36,871 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:36,875 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:36,921 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:31:36,923 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:31:37,128 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:37,131 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:37,342 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:37,345 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:37,551 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:37,553 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:37,773 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:37,776 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:37,993 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:31:37,996 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:31:37,997 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:31:49,585 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:31:49,588 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:31:49,615 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:32:02,256 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.546666666667 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:32:02,286 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:32:17,342 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:32:17,361 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1050000191 sec 2022-02-23 02:32:17,552 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 1.61589182873 | 5.99 GiB | 4.12 GiB | 2.03 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 1.40664322261 | 5.99 GiB | 4.10 GiB | 2.06 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.365572730611 | 5.99 GiB | 4.16 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.367235882284 | 5.99 GiB | 4.17 GiB | 1.98 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:32:17,553 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:32:17,555 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:32:17,825 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:33:14,676 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:33:15,611 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 249.43 MiB | 295.31 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 255.53 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 257.55 MiB | 237.92 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:33:15,611 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:33:26,265 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:33:26,288 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:33:42,299 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-----------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +-------+-----------------------------------------------------------------------------------------------------------+--------+ | 0.000 | **....................................................................................................**X | 58.400 | +-------+-----------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:33:42,726 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | **.......................***.............................................................................X | 243.000 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:33:43,743 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **..........................****..........................................................................X | 28726.500 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:33:45,173 | test | INFO | pool-3-thread-12 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 241.600 | ...................................................................................................X | 241.600 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:33:45,224 | test | INFO | pool-3-thread-18 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 243.000 | ...................................................................................................X | 243.000 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:33:45,250 | test | INFO | pool-3-thread-2 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 28726.500 | ...................................................................................................X | 28726.500 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:33:45,644 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 99.7133333333 | 5.99 GiB | 3.65 GiB | 2.61 GiB / 7.62 GiB | 19004 / 56402 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 100 | 5.99 GiB | 3.46 GiB | 2.80 GiB / 7.62 GiB | 92550 / 272620 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 98.9049328103 | 5.99 GiB | 3.61 GiB | 2.65 GiB / 7.62 GiB | 92174 / 268621 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 99.3452670005 | 5.99 GiB | 3.61 GiB | 2.66 GiB / 7.62 GiB | 92060 / 276850 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:33:49,505 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:34:35,509 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.10 MiB | 439.03 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.86 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 546.20 MiB | 435.73 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:34:35,510 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:34:41,568 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:34:41,992 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:34:41,993 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:34:41,996 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:34:48,105 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:34:48,234 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:35:03,493 | test | INFO | pool-3-thread-19 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.208333333333 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 97.8396624473 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.311666666667 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 100 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:35:03,592 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:35:04,252 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'bucket2' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 5122.400 | | 1764.600 | .................................X | 1764.600 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:35:04,375 | test | INFO | pool-3-thread-1 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 4987.200 | | 1193.000 | ......................X | 1193.000 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:35:04,733 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'default' +-------+----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **............................................*........................................................X | 18212.000 | +-------+----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:35:06,855 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 367.000 | ...................................................................................................X | 367.000 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:35:07,148 | test | INFO | pool-3-thread-18 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 138.800 | ...................................................................................................X | 138.800 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:35:08,542 | test | INFO | pool-3-thread-15 | [table_view:display:72] Ops trend for bucket 'default' +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | 15589.800 | ...................................................................................................*X | 15589.800 | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:35:13,898 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 5.64 2022-02-23 02:35:24,009 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 18.51 2022-02-23 02:35:34,096 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:35:44,177 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 35.03 2022-02-23 02:35:54,724 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 64.06 2022-02-23 02:36:04,766 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:36:14,881 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 79.21 2022-02-23 02:36:25,006 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:36:35,719 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:36:50,786 | test | INFO | pool-3-thread-19 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:36:50,878 | test | INFO | pool-3-thread-19 | [task:check:474] Rebalance completed with progress: 100% in 107.386999846 sec 2022-02-23 02:36:51,085 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:36:54,706 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:37:34,823 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 32562 | 800.00 MiB | 302.81 MiB | 261.92 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 37030 | 800.00 MiB | 363.73 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 295832 | 5.86 GiB | 571.28 MiB | 444.41 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:37:34,825 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:37:35,789 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:37:36,266 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:37:36,266 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:37:46,865 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:37:46,865 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:38:08,938 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:38:08,938 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 480.223s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-30-36/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 8m 12s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-38-49/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-38-49/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:38:53,424 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:38:53,868 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:39:16,164 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6599998474 seconds to complete 2022-02-23 02:39:16,187 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:39:21,450 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0xf11835e1, 0.0.0.0/0.0.0.0:45647] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x300c6413, 0.0.0.0/0.0.0.0:46102] timeout=300.0>) 2022-02-23 02:39:38,427 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:38,427 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0xfefb4bd4, 0.0.0.0/0.0.0.0:35388] timeout=300.0>) 2022-02-23 02:39:38,450 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x86c17428, 0.0.0.0/0.0.0.0:34154] timeout=300.0>) 2022-02-23 02:39:38,454 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x5a352554, 0.0.0.0/0.0.0.0:54516] timeout=300.0>) 2022-02-23 02:39:38,460 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0xe4078c28, 0.0.0.0/0.0.0.0:48544] timeout=300.0>) 2022-02-23 02:39:38,480 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x16e499ea, 0.0.0.0/0.0.0.0:35260] timeout=300.0>) 2022-02-23 02:39:40,473 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x5b09c94b, 0.0.0.0/0.0.0.0:55633] timeout=300.0>) 2022-02-23 02:39:40,474 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x0cd7e69c, 0.0.0.0/0.0.0.0:40241] timeout=300.0>) 2022-02-23 02:39:40,479 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x512d4d79, 0.0.0.0/0.0.0.0:56702] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xbf10a917, 0.0.0.0/0.0.0.0:57266] timeout=300.0>) 2022-02-23 02:39:40,482 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:40,483 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x68a95f6e, 0.0.0.0/0.0.0.0:52888] timeout=300.0>) 2022-02-23 02:39:40,496 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x8e907e9b, 0.0.0.0/0.0.0.0:53308] timeout=300.0>) 2022-02-23 02:39:42,493 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xec0c5e67, 0.0.0.0/0.0.0.0:45640] timeout=300.0>) 2022-02-23 02:39:42,496 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0xde7a38bb, 0.0.0.0/0.0.0.0:43380] timeout=300.0>) 2022-02-23 02:39:42,503 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0xcfb2471c, 0.0.0.0/0.0.0.0:60127] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0xb7a338b1, 0.0.0.0/0.0.0.0:42719] timeout=300.0>) 2022-02-23 02:39:42,507 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:42,507 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x7c671db2, 0.0.0.0/0.0.0.0:35520] timeout=300.0>) 2022-02-23 02:39:42,513 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x7fd01a19, 0.0.0.0/0.0.0.0:34555] timeout=300.0>) 2022-02-23 02:39:44,515 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x252705ff, 0.0.0.0/0.0.0.0:38352] timeout=300.0>) 2022-02-23 02:39:44,520 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x56538422, 0.0.0.0/0.0.0.0:55421] timeout=300.0>) 2022-02-23 02:39:44,528 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0xff50cb63, 0.0.0.0/0.0.0.0:36847] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0x3c106296, 0.0.0.0/0.0.0.0:44198] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x8b3e8827, 0.0.0.0/0.0.0.0:43615] timeout=300.0>) 2022-02-23 02:39:44,533 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:44,533 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:44,535 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x4f388a04, 0.0.0.0/0.0.0.0:50766] timeout=300.0>) 2022-02-23 02:39:46,532 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x7b7e7242, 0.0.0.0/0.0.0.0:46092] timeout=300.0>) 2022-02-23 02:39:46,536 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0xfb18aab1, 0.0.0.0/0.0.0.0:37047] timeout=300.0>) 2022-02-23 02:39:46,552 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x28 type=client open_count=1 channel=[id: 0x13239fd0, 0.0.0.0/0.0.0.0:47356] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x27 type=client open_count=1 channel=[id: 0xd6620d58, 0.0.0.0/0.0.0.0:48673] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x26 type=client open_count=1 channel=[id: 0xc98096c8, 0.0.0.0/0.0.0.0:43131] timeout=300.0>) 2022-02-23 02:39:46,559 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:46,559 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:46,559 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:39:50,959 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:50,963 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:51,009 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:39:51,012 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:39:51,233 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:51,236 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:51,438 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:51,443 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:51,645 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:51,648 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:51,852 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:51,857 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:52,055 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:39:52,059 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:39:52,059 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:40:03,599 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:40:03,601 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:40:03,631 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:40:17,490 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.156666666667 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:40:17,520 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:40:32,579 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:40:32,595 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1059999466 sec 2022-02-23 02:40:32,788 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 0 | 0.0 Byte | 0.0 Byte | 0.0 Byte / 0.0 Byte | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 2.42329294512 | 5.99 GiB | 4.09 GiB | 2.09 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.6 | 5.99 GiB | 4.11 GiB | 2.08 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.26040797249 | 5.99 GiB | 4.17 GiB | 1.98 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:40:32,790 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:40:32,792 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:40:33,082 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:41:23,822 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:41:24,634 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 265.18 MiB | 211.15 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 244.99 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 275.86 MiB | 175.92 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:41:24,637 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:41:35,392 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:41:35,417 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:41:51,164 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................**X | 108.900 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:41:52,424 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ***....................................***................................................................X | 27795.900 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:41:53,602 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+--------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+--------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***.................................***...................................................................*X | 224.000 | +-------+--------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:41:54,875 | test | INFO | pool-3-thread-13 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 191.100 | ...................................................................................................X | 191.100 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:41:54,921 | test | INFO | pool-3-thread-20 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 27795.900 | ...................................................................................................X | 27795.900 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:41:54,930 | test | INFO | pool-3-thread-14 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 224.000 | ...................................................................................................X | 224.000 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:41:55,256 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 99.6851870458 | 5.99 GiB | 3.62 GiB | 2.60 GiB / 7.62 GiB | 25658 / 75485 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 99.9729528704 | 5.99 GiB | 3.58 GiB | 2.66 GiB / 7.62 GiB | 26163 / 74852 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 99.2260497114 | 5.99 GiB | 3.61 GiB | 2.68 GiB / 7.62 GiB | 96800 / 289200 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 99.635 | 5.99 GiB | 3.63 GiB | 2.64 GiB / 7.62 GiB | 96400 / 289600 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:41:59,118 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:42:45,687 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.20 MiB | 393.40 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.90 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 536.57 MiB | 453.37 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:42:45,688 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:42:51,763 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:42:52,173 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:42:52,174 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:42:52,177 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:42:58,269 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:42:58,494 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:43:13,871 | test | INFO | pool-3-thread-11 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 4665.600 | | 2460.000 | ...................................................X | 2460.000 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:43:13,973 | test | INFO | pool-3-thread-16 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 92.6264371636 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.311666666667 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 82.9694613365 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.236662722288 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 92.4469184361 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:43:14,088 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:43:15,687 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'default' +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **.........................................*....................................................*.......X | 17211.200 | +-------+-----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:43:17,128 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'bucket2' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 4964.800 | | 2179.400 | ..........................................X | 2179.400 | | 164.400 | ..X | 164.400 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:43:18,605 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 113.200 | ...................................................................................................X | 113.200 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:43:18,687 | test | INFO | pool-3-thread-4 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 17211.200 | ...................................................................................................X | 17211.200 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:43:20,058 | test | INFO | pool-3-thread-3 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 164.400 | ...................................................................................................X | 164.400 | | 28.000 | ................X | 28.000 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:43:24,190 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 5.08 2022-02-23 02:43:34,249 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 22.22 2022-02-23 02:43:44,312 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:43:55,118 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 41.84 2022-02-23 02:44:05,163 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:44:15,206 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:44:25,280 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 81.05 2022-02-23 02:44:35,326 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:44:45,579 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:45:00,653 | test | INFO | pool-3-thread-16 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:45:00,736 | test | INFO | pool-3-thread-16 | [task:check:474] Rebalance completed with progress: 100% in 106.763999939 sec 2022-02-23 02:45:00,957 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:45:04,539 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:45:44,342 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 36988 | 800.00 MiB | 292.30 MiB | 242.16 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 37618 | 800.00 MiB | 391.47 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 296304 | 5.86 GiB | 575.08 MiB | 438.65 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:45:44,344 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:45:45,065 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:45:45,532 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:45:45,533 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:45:58,622 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:45:58,624 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:46:14,102 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:46:14,104 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 472.055s OK During the test, Remote Connections: 193, Disconnections: 191 SDK Connections: 30, Disconnections: 30 !!!!!! CRITICAL :: Shell disconnection mismatch !!!!! summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-38-49/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 8m 4s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-46-54/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-46-54/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:46:58,028 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:46:58,466 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:47:19,131 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.7109999657 seconds to complete 2022-02-23 02:47:19,154 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:47:24,388 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0xc22c03ff, 0.0.0.0/0.0.0.0:52533] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x7b2488aa, 0.0.0.0/0.0.0.0:39668] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0xbae131ef, 0.0.0.0/0.0.0.0:56176] timeout=300.0>) 2022-02-23 02:47:41,368 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:41,368 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x2beedd64, 0.0.0.0/0.0.0.0:51832] timeout=300.0>) 2022-02-23 02:47:41,381 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:41,392 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x618a0f81, 0.0.0.0/0.0.0.0:37179] timeout=300.0>) 2022-02-23 02:47:41,503 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x389d3a71, 0.0.0.0/0.0.0.0:54949] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x2f129dec, 0.0.0.0/0.0.0.0:40252] timeout=300.0>) 2022-02-23 02:47:43,410 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:43,410 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x6806bc4b, 0.0.0.0/0.0.0.0:54366] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x847cc6f9, 0.0.0.0/0.0.0.0:35092] timeout=300.0>) 2022-02-23 02:47:43,414 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:43,414 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x0edb406e, 0.0.0.0/0.0.0.0:59642] timeout=300.0>) 2022-02-23 02:47:43,516 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xcae53e44, 0.0.0.0/0.0.0.0:52524] timeout=300.0>) 2022-02-23 02:47:43,776 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x2e35a483, 0.0.0.0/0.0.0.0:59440] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x6c386b5c, 0.0.0.0/0.0.0.0:41208] timeout=300.0>) 2022-02-23 02:47:45,431 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xdd6d1a58, 0.0.0.0/0.0.0.0:54972] timeout=300.0>) 2022-02-23 02:47:45,431 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:45,434 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x6939c54c, 0.0.0.0/0.0.0.0:34594] timeout=300.0>) 2022-02-23 02:47:45,434 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x10e92881, 0.0.0.0/0.0.0.0:54558] timeout=300.0>) 2022-02-23 02:47:45,529 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0xeb78e805, 0.0.0.0/0.0.0.0:45730] timeout=300.0>) 2022-02-23 02:47:45,792 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0xb0453dec, 0.0.0.0/0.0.0.0:59880] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x38d78465, 0.0.0.0/0.0.0.0:48835] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x8613109d, 0.0.0.0/0.0.0.0:52668] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x821ad95c, 0.0.0.0/0.0.0.0:41672] timeout=300.0>) 2022-02-23 02:47:47,459 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:47,460 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:47,459 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:47,460 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0xd7133c20, 0.0.0.0/0.0.0.0:42872] timeout=300.0>) 2022-02-23 02:47:47,540 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xe7934f28, 0.0.0.0/0.0.0.0:39347] timeout=300.0>) 2022-02-23 02:47:47,805 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x66adb235, 0.0.0.0/0.0.0.0:59151] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0xea8e1f46, 0.0.0.0/0.0.0.0:42988] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0xc70f638f, 0.0.0.0/0.0.0.0:37056] timeout=300.0>) 2022-02-23 02:47:49,484 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:49,484 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:49,484 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0xda4370d8, 0.0.0.0/0.0.0.0:54116] timeout=300.0>) 2022-02-23 02:47:49,816 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:47:55,101 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:55,105 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:55,148 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:47:55,151 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:47:55,322 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:55,326 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:55,536 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:55,539 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:55,747 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:55,750 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:55,954 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:55,957 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:56,161 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:47:56,164 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:47:56,164 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:48:07,736 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:48:07,737 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:48:07,769 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:48:20,513 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.573333333333 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:48:20,543 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:48:35,598 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:48:35,615 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1050000191 sec 2022-02-23 02:48:35,811 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 2.40205652094 | 5.99 GiB | 4.13 GiB | 2.05 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 1.015 | 5.99 GiB | 4.10 GiB | 2.06 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.26040797249 | 5.99 GiB | 4.13 GiB | 2.01 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.338333333333 | 5.99 GiB | 4.17 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:48:35,812 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:48:35,812 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:48:36,094 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:49:25,749 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:49:26,592 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 267.24 MiB | 258.94 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 267.59 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 265.11 MiB | 209.46 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:49:26,595 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:49:37,404 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:49:37,430 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:49:53,776 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | **....................................................................................................***X | 62.200 | +-------+------------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:49:55,117 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | **..................****..................................................................................X | 247.500 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:49:55,243 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **..............****......................................................................................X | 30485.500 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:49:56,640 | test | INFO | pool-3-thread-11 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 228.800 | ...................................................................................................X | 228.800 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:49:56,657 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 247.500 | ...................................................................................................X | 247.500 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:49:56,676 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 30485.500 | ...................................................................................................X | 30485.500 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:49:57,012 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 99.6868668263 | 5.99 GiB | 3.63 GiB | 2.61 GiB / 7.62 GiB | 88398 / 266399 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 99.4007278069 | 5.99 GiB | 3.59 GiB | 2.67 GiB / 7.62 GiB | 89124 / 265415 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 96.0622297895 | 5.99 GiB | 3.53 GiB | 2.73 GiB / 7.62 GiB | 89124 / 265998 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 99.842843529 | 5.99 GiB | 3.66 GiB | 2.61 GiB / 7.62 GiB | 88761 / 265182 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:50:00,983 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:50:47,740 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.00 MiB | 398.96 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.89 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 537.64 MiB | 421.55 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:50:47,740 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:50:53,927 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:50:54,365 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:50:54,367 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:50:54,371 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:51:00,209 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:51:00,427 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:51:17,369 | test | INFO | pool-3-thread-21 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 59.4960486241 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.155 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 97.3432447748 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.285004750079 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 93.0517938944 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:51:17,444 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:51:18,081 | test | INFO | pool-3-thread-2 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *..............*......................................................................................*X | 5234.800 | | 120.000 | .X | 120.000 | +---------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:51:19,964 | test | INFO | pool-3-thread-12 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *................**....................................................................................X | 5143.000 | | 110.000 | .*X | 110.000 | +---------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:51:21,545 | test | INFO | pool-3-thread-5 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | *..........**.........................................................*.................................*X | 20113.800 | | 18190.600 | .........................................................................................X | 18190.600 | +-----------+------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:51:23,042 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 96.000 | ...................................................................................................X | 96.000 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:51:24,780 | test | INFO | pool-3-thread-7 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 73.200 | ...................................................................................................X | 73.200 | | 0.000 | X | 0.000 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:51:26,282 | test | INFO | pool-3-thread-30 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 18190.600 | ...................................................................................................X | 18190.600 | | 0.000 | *X | 0.000 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:51:27,599 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 6.01 2022-02-23 02:51:37,706 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 27.13 2022-02-23 02:51:47,765 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:51:58,500 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 44.62 2022-02-23 02:52:08,546 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:52:18,963 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 02:52:29,292 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 86.59 2022-02-23 02:52:39,342 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 02:52:54,405 | test | INFO | pool-3-thread-21 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:52:54,500 | test | INFO | pool-3-thread-21 | [task:check:474] Rebalance completed with progress: 100% in 97.131000042 sec 2022-02-23 02:52:54,698 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 02:52:58,694 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:53:38,773 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 32114 | 800.00 MiB | 292.22 MiB | 310.09 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 32002 | 800.00 MiB | 359.81 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 366496 | 5.86 GiB | 669.20 MiB | 480.39 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:53:38,775 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 02:53:39,677 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 02:53:40,154 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 02:53:40,154 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 02:53:50,471 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 02:53:50,473 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 02:54:07,178 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 02:54:07,180 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 462.829s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-46-54/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 55s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-54-49/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-54-49/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 02:54:53,463 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:54:53,960 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:55:13,635 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6519999504 seconds to complete 2022-02-23 02:55:13,657 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 02:55:18,914 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x58fa818a, 0.0.0.0/0.0.0.0:40791] timeout=300.0>) 2022-02-23 02:55:35,924 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x60a92aa6, 0.0.0.0/0.0.0.0:46354] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x955b494f, 0.0.0.0/0.0.0.0:53685] timeout=300.0>) 2022-02-23 02:55:35,938 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:35,940 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x670ed605, 0.0.0.0/0.0.0.0:49826] timeout=300.0>) 2022-02-23 02:55:35,951 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x3d0f894a, 0.0.0.0/0.0.0.0:47541] timeout=300.0>) 2022-02-23 02:55:35,987 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x7ed06b50, 0.0.0.0/0.0.0.0:51334] timeout=300.0>) 2022-02-23 02:55:37,960 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x93b663a5, 0.0.0.0/0.0.0.0:45387] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0xf7b84631, 0.0.0.0/0.0.0.0:35839] timeout=300.0>) 2022-02-23 02:55:37,967 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:37,967 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0x95e8f243, 0.0.0.0/0.0.0.0:48078] timeout=300.0>) 2022-02-23 02:55:37,971 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0xae8e43cb, 0.0.0.0/0.0.0.0:44895] timeout=300.0>) 2022-02-23 02:55:38,006 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xb73b4012, 0.0.0.0/0.0.0.0:52140] timeout=300.0>) 2022-02-23 02:55:38,329 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0xcf0b7771, 0.0.0.0/0.0.0.0:32845] timeout=300.0>) 2022-02-23 02:55:39,982 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x33ed7baa, 0.0.0.0/0.0.0.0:35613] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xb28c7920, 0.0.0.0/0.0.0.0:42913] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0x8d03e173, 0.0.0.0/0.0.0.0:37753] timeout=300.0>) 2022-02-23 02:55:39,990 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:39,990 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:39,990 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0xa1261ee6, 0.0.0.0/0.0.0.0:34441] timeout=300.0>) 2022-02-23 02:55:40,019 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x91b48cd8, 0.0.0.0/0.0.0.0:33314] timeout=300.0>) 2022-02-23 02:55:40,342 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x9fb0c721, 0.0.0.0/0.0.0.0:58318] timeout=300.0>) 2022-02-23 02:55:41,993 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0x972cc995, 0.0.0.0/0.0.0.0:55004] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x4c6e619f, 0.0.0.0/0.0.0.0:56581] timeout=300.0>)Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x9f1e992a, 0.0.0.0/0.0.0.0:59402] timeout=300.0>) 2022-02-23 02:55:42,009 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:42,009 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:42,009 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x07e448f6, 0.0.0.0/0.0.0.0:38055] timeout=300.0>) 2022-02-23 02:55:42,028 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xba3ee8f4, 0.0.0.0/0.0.0.0:51771] timeout=300.0>) 2022-02-23 02:55:42,357 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x74545e2f, 0.0.0.0/0.0.0.0:37585] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x7c584e4a, 0.0.0.0/0.0.0.0:42023] timeout=300.0>) 2022-02-23 02:55:44,028 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:44,029 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x4d950ee1, 0.0.0.0/0.0.0.0:33450] timeout=300.0>) 2022-02-23 02:55:44,039 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0x6a053109, 0.0.0.0/0.0.0.0:34186] timeout=300.0>) 2022-02-23 02:55:44,368 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x26 type=client open_count=1 channel=[id: 0xfaf767e2, 0.0.0.0/0.0.0.0:42674] timeout=300.0>) 2022-02-23 02:55:46,381 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 02:55:50,956 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:50,960 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:51,059 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 02:55:51,061 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 02:55:51,164 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:51,167 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:51,430 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:51,434 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:51,642 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:51,645 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:51,848 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:51,854 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:52,059 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 02:55:52,062 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 02:55:52,062 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 02:56:03,611 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 02:56:03,612 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:56:03,641 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:56:16,686 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.808319861336 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:56:16,723 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:56:31,783 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 02:56:31,799 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1159999371 sec 2022-02-23 02:56:31,996 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 1.66928187494 | 5.99 GiB | 4.16 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 1.90163497275 | 5.99 GiB | 4.10 GiB | 2.07 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 1.85454120554 | 5.99 GiB | 4.11 GiB | 2.04 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.34 | 5.99 GiB | 4.16 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:56:31,997 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:56:31,999 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:56:32,267 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 02:57:22,756 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 02:57:23,552 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 266.43 MiB | 237.52 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 251.45 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 282.46 MiB | 181.99 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 02:57:23,553 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 02:57:34,239 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:57:34,269 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:57:50,250 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................**X | 130.500 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:57:51,489 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'default' +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ***....................................................................................................***X | 13457.800 | +-------+-------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:57:51,816 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................***X | 108.100 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:57:53,220 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 169.500 | ...................................................................................................X | 169.500 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:57:54,421 | test | INFO | pool-3-thread-29 | [table_view:display:72] Ops trend for bucket 'default' +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ | 24542.200 | ...................................................................................................*X | 24542.200 | +-----------+-------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:57:54,461 | test | INFO | pool-3-thread-5 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+-------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-------------------------------------------------------------------------------------------------------+---------+ | 191.900 | ...................................................................................................*X | 191.900 | +---------+-------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 02:57:54,815 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 99.2187891231 | 5.99 GiB | 3.62 GiB | 2.63 GiB / 7.62 GiB | 96000 / 290000 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 99.6584619008 | 5.99 GiB | 3.57 GiB | 2.67 GiB / 7.62 GiB | 96800 / 289200 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 97.2916666667 | 5.99 GiB | 3.59 GiB | 2.68 GiB / 7.62 GiB | 96800 / 289200 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 99.3990685563 | 5.99 GiB | 3.63 GiB | 2.64 GiB / 7.62 GiB | 96400 / 289600 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 02:57:58,575 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 02:58:45,596 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.13 MiB | 400.45 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.88 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 537.52 MiB | 453.95 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 02:58:45,598 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 02:58:51,630 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 02:58:52,055 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 02:58:52,058 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 02:58:52,061 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 02:58:57,831 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 02:58:58,101 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 02:59:14,654 | test | INFO | pool-3-thread-7 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 94.9998333278 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.258337638961 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 99.1640473484 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.206670111169 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 95.0309735979 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 02:59:14,838 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 02:59:15,012 | test | INFO | pool-3-thread-16 | [table_view:display:72] Ops trend for bucket 'bucket2' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 4570.000 | | 1574.000 | .................................X | 1574.000 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:59:17,223 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'default' +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **......................................................*..............................................X | 15618.200 | | 14908.000 | ..............................................................................................X | 14908.000 | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 02:59:18,163 | test | INFO | pool-3-thread-1 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 4218.600 | | 2917.400 | ....................................................................X | 2917.400 | | 141.400 | ..X | 141.400 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:59:19,604 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 30.800 | ...................................................................................................X | 30.800 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:59:21,174 | test | INFO | pool-3-thread-24 | [table_view:display:72] Ops trend for bucket 'default' +----------+-------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-------------------------------------------------------------------------------------------------------+----------+ | 5933.800 | ...................................................................................................*X | 5933.800 | +----------+-------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 02:59:22,433 | test | INFO | pool-3-thread-21 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+--------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+--------------------------------------------------------------------------------------------------------+--------+ | 53.800 | ...................................................................................................**X | 53.800 | +--------+--------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 02:59:25,423 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 10.96 2022-02-23 02:59:35,473 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:59:45,519 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 02:59:57,079 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 55.97 2022-02-23 03:00:07,130 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 03:00:17,530 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 77.24 2022-02-23 03:00:27,585 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 94.44 2022-02-23 03:00:37,625 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 03:00:52,693 | test | INFO | pool-3-thread-7 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 03:00:52,782 | test | INFO | pool-3-thread-7 | [task:check:474] Rebalance completed with progress: 100% in 98.1270000935 sec 2022-02-23 03:00:53,062 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 03:00:56,767 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 03:01:36,881 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 37576 | 800.00 MiB | 308.75 MiB | 335.33 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 32058 | 800.00 MiB | 361.37 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 303128 | 5.86 GiB | 584.03 MiB | 436.32 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 03:01:36,882 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 03:01:37,813 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 03:01:38,279 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 03:01:38,279 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 03:01:48,713 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 03:01:48,714 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 03:02:11,338 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 03:02:11,338 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 466.473s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_02-54-49/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 59s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-02-49/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-02-49/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 03:02:52,959 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:02:53,467 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:03:15,082 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.7110002041 seconds to complete 2022-02-23 03:03:15,117 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 03:03:20,361 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0xe6f0271e, 0.0.0.0/0.0.0.0:39631] timeout=300.0>) 2022-02-23 03:03:37,414 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x58bab06c, 0.0.0.0/0.0.0.0:55070] timeout=300.0>) 2022-02-23 03:03:37,437 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0x1e417039, 0.0.0.0/0.0.0.0:56599] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x98113d82, 0.0.0.0/0.0.0.0:46963] timeout=300.0>) 2022-02-23 03:03:37,450 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:03:37,451 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x7ec4e853, 0.0.0.0/0.0.0.0:52483] timeout=300.0>) 2022-02-23 03:03:37,471 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x896417b3, 0.0.0.0/0.0.0.0:46068] timeout=300.0>) 2022-02-23 03:03:37,483 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0xdc9002a5, 0.0.0.0/0.0.0.0:56955] timeout=300.0>) 2022-02-23 03:03:39,431 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0xaa2dfffd, 0.0.0.0/0.0.0.0:40109] timeout=300.0>) 2022-02-23 03:03:39,470 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0xea0542b9, 0.0.0.0/0.0.0.0:50312] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x29851d5b, 0.0.0.0/0.0.0.0:39769] timeout=300.0>) 2022-02-23 03:03:39,482 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:03:39,483 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0x163bf6b9, 0.0.0.0/0.0.0.0:57235] timeout=300.0>) 2022-02-23 03:03:39,490 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0xceffc196, 0.0.0.0/0.0.0.0:41920] timeout=300.0>) 2022-02-23 03:03:39,496 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0xcdab56a8, 0.0.0.0/0.0.0.0:41604] timeout=300.0>) 2022-02-23 03:03:41,447 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xc0db424b, 0.0.0.0/0.0.0.0:51168] timeout=300.0>) 2022-02-23 03:03:41,497 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0xcabf1cc7, 0.0.0.0/0.0.0.0:33414] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x3c509238, 0.0.0.0/0.0.0.0:52601] timeout=300.0>) 2022-02-23 03:03:41,500 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:03:41,505 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0x7885e22e, 0.0.0.0/0.0.0.0:56686] timeout=300.0>) 2022-02-23 03:03:41,509 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x85a1adb4, 0.0.0.0/0.0.0.0:51764] timeout=300.0>) 2022-02-23 03:03:41,513 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0xe19ef155, 0.0.0.0/0.0.0.0:48761] timeout=300.0>) 2022-02-23 03:03:43,459 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0xa784e3a8, 0.0.0.0/0.0.0.0:37427] timeout=300.0>) 2022-02-23 03:03:43,520 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0xcf35702f, 0.0.0.0/0.0.0.0:55995] timeout=300.0>) 2022-02-23 03:03:43,525 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x7c072c39, 0.0.0.0/0.0.0.0:51160] timeout=300.0>) 2022-02-23 03:03:43,529 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xb732deff, 0.0.0.0/0.0.0.0:58558] timeout=300.0>) 2022-02-23 03:03:43,530 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0x35769169, 0.0.0.0/0.0.0.0:45054] timeout=300.0>) 2022-02-23 03:03:43,532 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x21a3d20a, 0.0.0.0/0.0.0.0:45939] timeout=300.0>) 2022-02-23 03:03:45,542 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x3cc9d987, 0.0.0.0/0.0.0.0:43398] timeout=300.0>) 2022-02-23 03:03:45,545 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0xc8282e66, 0.0.0.0/0.0.0.0:33477] timeout=300.0>) Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x26 type=client open_count=1 channel=[id: 0xc25e5aaa, 0.0.0.0/0.0.0.0:35068] timeout=300.0>) 2022-02-23 03:03:45,555 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:03:45,555 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:03:49,719 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:49,723 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:49,776 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 03:03:49,779 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 03:03:49,986 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:49,997 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:50,207 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:50,210 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:50,415 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:50,420 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:50,631 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:50,635 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:50,829 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:03:50,834 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:03:50,835 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 03:04:02,404 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 03:04:02,405 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:04:02,434 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:04:15,171 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.418326361227 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 03:04:15,203 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 03:04:30,260 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 03:04:30,279 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1070001125 sec 2022-02-23 03:04:30,451 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 1.64 | 5.99 GiB | 4.17 GiB | 1.97 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 2.9903151729 | 5.99 GiB | 4.09 GiB | 2.08 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.209996500058 | 5.99 GiB | 4.09 GiB | 2.05 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.415006916782 | 5.99 GiB | 4.17 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 03:04:30,453 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:04:30,453 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:04:30,726 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 03:05:21,375 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 03:05:22,259 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 256.70 MiB | 212.29 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 245.36 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 261.31 MiB | 169.93 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 03:05:22,260 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 03:05:33,203 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 03:05:33,229 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 03:05:47,732 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+-----------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-----------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................*X | 145.500 | +-------+-----------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:05:48,707 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***....................................................................................................**X | 149.200 | +-------+------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:05:49,552 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'default' +-------+------------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | ***....................................................................................................**X | 17838.800 | +-------+------------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:05:50,927 | test | INFO | pool-3-thread-12 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 145.500 | ...................................................................................................X | 145.500 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:05:50,960 | test | INFO | pool-3-thread-14 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 149.200 | ...................................................................................................X | 149.200 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:05:50,987 | test | INFO | pool-3-thread-11 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 17838.800 | ...................................................................................................X | 17838.800 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:05:51,345 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 95.2276027843 | 5.99 GiB | 3.63 GiB | 2.63 GiB / 7.62 GiB | 45013 / 129009 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 95.0439021133 | 5.99 GiB | 3.59 GiB | 2.68 GiB / 7.62 GiB | 45380 / 130408 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 48.6958115969 | 5.99 GiB | 3.62 GiB | 2.64 GiB / 7.62 GiB | 45275 / 128615 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 47.7233954451 | 5.99 GiB | 3.66 GiB | 2.64 GiB / 7.62 GiB | 45660 / 132297 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 03:05:55,142 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 03:06:42,092 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.22 MiB | 395.51 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.88 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 536.45 MiB | 433.85 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 03:06:42,092 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:06:48,128 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 03:06:48,539 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 03:06:48,539 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 03:06:48,543 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 03:06:54,983 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 03:06:55,173 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 03:07:12,042 | test | INFO | pool-3-thread-24 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 95.4166666667 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.183333333333 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 99.371363606 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.391660138998 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 99.795257909 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 03:07:12,184 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 03:07:12,760 | test | INFO | pool-3-thread-3 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+----------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+----------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *.............................**.......................................................................X | 4674.400 | | 165.200 | ..X | 165.200 | +---------+----------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 03:07:14,770 | test | INFO | pool-3-thread-9 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *..........*..........................................................................................X | 6374.600 | | 112.600 | *X | 112.600 | +---------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 03:07:16,085 | test | INFO | pool-3-thread-20 | [table_view:display:72] Ops trend for bucket 'default' +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | *...................**.................................................................................X | 12932.800 | | 12782.600 | .................................................................................................X | 12782.600 | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:07:17,622 | test | INFO | pool-3-thread-1 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 97.200 | ...................................................................................................X | 97.200 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 03:07:17,647 | test | INFO | pool-3-thread-28 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 62.200 | ...................................................................................................X | 62.200 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 03:07:17,674 | test | INFO | pool-3-thread-2 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 12782.600 | ...................................................................................................X | 12782.600 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:07:22,285 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 10.68 2022-02-23 03:07:32,335 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 03:07:42,384 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 03:07:53,227 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 53.49 2022-02-23 03:08:03,282 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 03:08:13,328 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 72.4 2022-02-23 03:08:23,391 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 89.24 2022-02-23 03:08:33,447 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 03:08:48,507 | test | INFO | pool-3-thread-24 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 03:08:48,591 | test | INFO | pool-3-thread-24 | [task:check:474] Rebalance completed with progress: 100% in 96.5500001907 sec 2022-02-23 03:08:48,793 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 03:08:52,438 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 03:09:32,055 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 36946 | 800.00 MiB | 291.49 MiB | 319.38 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 32562 | 800.00 MiB | 383.76 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 306776 | 5.86 GiB | 593.78 MiB | 440.96 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 03:09:32,056 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 03:09:32,776 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 03:09:33,240 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 03:09:33,240 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 03:09:46,293 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 03:09:46,295 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 03:10:05,174 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 03:10:05,176 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 460.380s OK During the test, Remote Connections: 192, Disconnections: 193 SDK Connections: 30, Disconnections: 30 !!!!!! CRITICAL :: Shell disconnection mismatch !!!!! summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-02-49/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 53s 2 actionable tasks: 1 executed, 1 up-to-date + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P transaction_version=1.1.8 -P client_version=3.1.6 -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest' > Configure project : Using Transaction_client :: 1.1.8 Using Java_client :: 3.1.6 Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/ssh.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar scripts/eagles_all_around.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main scripts/install.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/temp_rebalance_magma_win/build/classes/java/main:/data/workspace/temp_rebalance_magma_win/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.14.0/75d45d21dc208fa369abc832354470464c859d67/azure-storage-blob-12.14.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.8/e69a6013e59f498f76671c1acc43df14f1163180/couchbase-transactions-1.1.8.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.1.6/f065d71963e08bd5577838592e33f2ca35f5d64a/java-client-3.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.1.0/c5882c519f8ee15c528e9d0396ec7535da7d4ecd/azure-storage-internal-avro-12.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.13.0/ef8910849375def2b715ea64429136e694fb7ad6/azure-storage-common-12.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.11.0/2177ae2dc9cff849e49f9180bf6b95b8e2c78e1b/azure-core-http-netty-1.11.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.20.0/a98c6bd18aa2066ecd8b39bf7ac51bd8e7307851/azure-core-1.20.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.32/cdcff33940d9f2de763bc41ea05a0be5941176c3/slf4j-api-1.7.32.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.1.6/b3ece73ab7069b1e97669500edc448163c2f4304/core-io-2.1.6.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.12.4/15c743856696c0239f2c51d8d19d9f97f034713/jackson-dataformat-xml-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.module/jackson-module-jaxb-annotations/2.12.4/5e43703aae1a9843dfd7df0a0ad6cbfedcaff67f/jackson-module-jaxb-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.12.4/6a1bd259b6c4e3f9219ec8ec0be55ed11eed0c/jackson-core-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.12.4/b1174c05d4ded121a7eaeed3f148709f9585b981/jackson-datatype-jsr310-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.12.4/69206e02e6a696034f06a59d3ddbfbba5a4cd81/jackson-databind-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.12.4/752cf9a2562ac2c012e48057e3a4c17dad66c66e/jackson-annotations-2.12.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty/1.0.10/c54f6c92628f396076f74945424319746bbb37f8/reactor-netty-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http-brave/1.0.10/30aebc029ee25f5e0c2d1c0a798b17e926f61b8/reactor-netty-http-brave-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.10/f34196d8778243d2ac4a4ae7cc74f110d1073803/reactor-netty-http-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.10/dcb5d53dc07a6f660060f0b55c40a1e9944a6fe1/reactor-netty-core-1.0.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.4.9/820332aa7b0fe3a8dfe14f58fc16e49ad178291/reactor-core-3.4.9.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.40.Final/6b73a163c13ed76921892d28eb81235f4b41e40a/netty-tcnative-boringssl-static-2.0.40.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.67.Final/2528292c49bd15f1b328dda25a7a75744d6f0991/netty-handler-proxy-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.67.Final/e2a0c27f396035fab7d932031d6f337244369495/netty-codec-http2-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.67.Final/e282137917c67332fa9a414df89f89a93487aede/netty-codec-http-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.66.Final/8ca314d87b202a4dd94d810d2385b22555dd801c/netty-resolver-dns-native-macos-4.1.66.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.66.Final/7b74815fb1403e5747c872c6eee2a07e7a700d30/netty-resolver-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.67.Final/62640a6524e1c08d6e8ac06556892b5e1362392f/netty-handler-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.67.Final/ff955604e1edb8b13dc855ccbc84acb5fc1d989/netty-transport-native-epoll-4.1.67.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.67.Final/7a88ccb4237d1ff091be544860ae729f5b568ac/netty-transport-native-kqueue-4.1.67.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.67.Final/c6cca7ba897e1ac65e0742654ed10064401dbd2f/netty-transport-native-unix-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.67.Final/a4fe0487451dc262daaa024224fa207d088b8687/netty-codec-socks-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.66.Final/390ff96a0e1f7c626cb52c119a1a1dfd0784d193/netty-codec-dns-4.1.66.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.67.Final/292e818822a4fca4e9f3ad711cdd46362f69590a/netty-codec-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.67.Final/e8b502618f960cb1f8cdb7dca92d0878576ad7c6/netty-transport-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.67.Final/4b6217b05792fe6e2bd080c054138b2c20ae1b37/netty-buffer-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.2.4/16b9f8ab972e67eb21872ea2c40046249d543989/woodstox-core-6.2.4.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.67.Final/bb9041d5f85f9a6270f5378d0becd243de8cfeac/netty-resolver-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.67.Final/a86a19033588a07e159ff95818845b1ec86b2281/netty-common-4.1.67.Final.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.xml.bind/jakarta.xml.bind-api/2.3.2/8d49996a4338670764d7ca4b85a1c4ccf7fe665d/jakarta.xml.bind-api-2.3.2.jar:/root/.gradle/caches/modules-2/files-2.1/jakarta.activation/jakarta.activation-api/1.2.1/562a587face36ec7eff2db7f2fc95425c6602bc1/jakarta.activation-api-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave-instrumentation-http/5.13.3/fe70809f06c786b171e4597747c6f5a8c911fe5f/brave-instrumentation-http-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.brave/brave/5.13.3/2d8ecb2352108f95b3e66ccc8027e9343ad9852c/brave-5.13.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter-brave/2.16.3/4d5017d71e4de139b6a31612cfd837b7c71d288c/zipkin-reporter-brave-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.reporter2/zipkin-reporter/2.16.3/7e43d8be3376d305c355d969e8b9f3a62221380/zipkin-reporter-2.16.3.jar:/root/.gradle/caches/modules-2/files-2.1/io.zipkin.zipkin2/zipkin/2.23.2/1c2c7f2e91a3749311f7f75d0535d14ba2e2f6/zipkin-2.23.2.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini -p rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections -m rest > Task :compileJava UP-TO-DATE > Task :testrunner Global Test input params: {'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'get-cbcollect-info': 'True', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'num_nodes': 6, 'rerun': 'False'} Logs will be stored at /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-10-41/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma_win.ini rerun=False,get-cbcollect-info=True -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,data_load_stage=before,quota_percent=80,skip_validations=False,nodes_init=4,rebalance_moves_per_node=32,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,scrape_interval=5,data_load_spec=volume_test_load_with_CRUD_on_collections' Test Input params: {'data_load_stage': 'before', 'cluster_name': 'win10-bucket-ops-temp_rebalance_magma_win', 'quota_percent': '80', 'ini': '/tmp/win10-bucket-ops-temp_rebalance_magma_win.ini', 'get-cbcollect-info': 'True', 'skip_validations': 'False', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-10-41/test_1', 'nodes_init': '4', 'rebalance_moves_per_node': '32', 'nodes_swap': '2', 'bucket_spec': 'multi_bucket.buckets_for_rebalance_tests_more_collections', 'case_number': 1, 'scrape_interval': '5', 'data_load_spec': 'volume_test_load_with_CRUD_on_collections'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2022-02-23 03:10:45,693 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:10:46,177 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:11:06,696 | test | INFO | MainThread | [rest_client:monitorRebalance:1599] Rebalance done. Taken 11.6700000763 seconds to complete 2022-02-23 03:11:06,713 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2022-02-23 03:11:11,963 | test | INFO | MainThread | [basetestcase:initialize_cluster:468] Initializing cluster : C1 Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0xb type=client open_count=1 channel=[id: 0x4895a2f2, 0.0.0.0/0.0.0.0:47849] timeout=300.0>) 2022-02-23 03:11:28,865 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0xc type=client open_count=1 channel=[id: 0x1275a481, 0.0.0.0/0.0.0.0:33728] timeout=300.0>) 2022-02-23 03:11:28,881 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0xd type=client open_count=1 channel=[id: 0xd56d7482, 0.0.0.0/0.0.0.0:46055] timeout=300.0>) 2022-02-23 03:11:28,933 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0xe type=client open_count=1 channel=[id: 0x98f6a757, 0.0.0.0/0.0.0.0:46522] timeout=300.0>) 2022-02-23 03:11:28,944 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0xf type=client open_count=1 channel=[id: 0x0450d267, 0.0.0.0/0.0.0.0:48170] timeout=300.0>) 2022-02-23 03:11:28,953 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x10 type=client open_count=1 channel=[id: 0x361d99f5, 0.0.0.0/0.0.0.0:38189] timeout=300.0>) 2022-02-23 03:11:30,884 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x11 type=client open_count=1 channel=[id: 0x3aecafb9, 0.0.0.0/0.0.0.0:52238] timeout=300.0>) 2022-02-23 03:11:30,898 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x12 type=client open_count=1 channel=[id: 0x44de8e08, 0.0.0.0/0.0.0.0:39169] timeout=300.0>) 2022-02-23 03:11:30,947 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x13 type=client open_count=1 channel=[id: 0xc1f9644e, 0.0.0.0/0.0.0.0:47585] timeout=300.0>) 2022-02-23 03:11:30,957 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x14 type=client open_count=1 channel=[id: 0x4ea1b94f, 0.0.0.0/0.0.0.0:35210] timeout=300.0>) 2022-02-23 03:11:30,967 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x15 type=client open_count=1 channel=[id: 0xde703e9a, 0.0.0.0/0.0.0.0:34732] timeout=300.0>) 2022-02-23 03:11:31,377 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x16 type=client open_count=1 channel=[id: 0x051424ee, 0.0.0.0/0.0.0.0:36031] timeout=300.0>) 2022-02-23 03:11:32,898 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x17 type=client open_count=1 channel=[id: 0x1c437160, 0.0.0.0/0.0.0.0:55069] timeout=300.0>) 2022-02-23 03:11:32,907 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x18 type=client open_count=1 channel=[id: 0xa8b8cc91, 0.0.0.0/0.0.0.0:41318] timeout=300.0>) 2022-02-23 03:11:32,960 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x19 type=client open_count=1 channel=[id: 0xf183b3c6, 0.0.0.0/0.0.0.0:41268] timeout=300.0>) 2022-02-23 03:11:32,970 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x1a type=client open_count=1 channel=[id: 0x80e6a2b0, 0.0.0.0/0.0.0.0:53134] timeout=300.0>) 2022-02-23 03:11:32,982 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x1b type=client open_count=1 channel=[id: 0xe75e3b5a, 0.0.0.0/0.0.0.0:36831] timeout=300.0>) 2022-02-23 03:11:33,391 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.162:8091 during connect (<_realsocket at 0x1c type=client open_count=1 channel=[id: 0x264cf5de, 0.0.0.0/0.0.0.0:59907] timeout=300.0>) 2022-02-23 03:11:34,913 | test | ERROR | pool-3-thread-15 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.162:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.154:8091 during connect (<_realsocket at 0x1d type=client open_count=1 channel=[id: 0xebbf46b9, 0.0.0.0/0.0.0.0:51342] timeout=300.0>) 2022-02-23 03:11:34,917 | test | ERROR | pool-3-thread-17 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.154:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.160:8091 during connect (<_realsocket at 0x1e type=client open_count=1 channel=[id: 0x83213776, 0.0.0.0/0.0.0.0:51183] timeout=300.0>) 2022-02-23 03:11:34,973 | test | ERROR | pool-3-thread-14 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.160:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x1f type=client open_count=1 channel=[id: 0x92057a12, 0.0.0.0/0.0.0.0:47710] timeout=300.0>) 2022-02-23 03:11:34,982 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x20 type=client open_count=1 channel=[id: 0x48814129, 0.0.0.0/0.0.0.0:35664] timeout=300.0>) 2022-02-23 03:11:34,993 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x21 type=client open_count=1 channel=[id: 0xf6ad6462, 0.0.0.0/0.0.0.0:57524] timeout=300.0>) 2022-02-23 03:11:35,403 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.156:8091 during connect (<_realsocket at 0x22 type=client open_count=1 channel=[id: 0xe5b24e09, 0.0.0.0/0.0.0.0:47865] timeout=300.0>) 2022-02-23 03:11:36,993 | test | ERROR | pool-3-thread-13 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.156:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.152:8091 during connect (<_realsocket at 0x23 type=client open_count=1 channel=[id: 0x83a946bf, 0.0.0.0/0.0.0.0:40258] timeout=300.0>) 2022-02-23 03:11:37,003 | test | ERROR | pool-3-thread-18 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.152:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x24 type=client open_count=1 channel=[id: 0x1347f1f4, 0.0.0.0/0.0.0.0:57001] timeout=300.0>) 2022-02-23 03:11:37,415 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused Got this failure java.net.ConnectException: Connection refused: /172.23.136.158:8091 during connect (<_realsocket at 0x25 type=client open_count=1 channel=[id: 0x111eecc0, 0.0.0.0/0.0.0.0:57259] timeout=300.0>) 2022-02-23 03:11:39,427 | test | ERROR | pool-3-thread-16 | [rest_client:_http_request:838] Socket error while connecting to http://172.23.136.158:8091/nodes/self error [Errno 111] Connection refused 2022-02-23 03:11:43,240 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.156:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:43,243 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:43,288 | infra | CRITICAL | pool-3-thread-19 | [task:call:6177] mcdMemoryReserved reported in nodes/self is: 4908 2022-02-23 03:11:43,289 | test | CRITICAL | pool-3-thread-19 | [table_view:display:72] Memory quota allocated: +---------------------+--------+ | Service | RAM mb | +---------------------+--------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+--------+ 2022-02-23 03:11:43,509 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.160:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:43,513 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:43,721 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.162:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:43,726 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:43,927 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.158:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:43,930 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:44,134 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.154:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:44,138 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:44,341 | test | ERROR | MainThread | [rest_client:_http_request:834] POST http://172.23.136.152:8091//nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2022-02-23 03:11:44,344 | test | ERROR | MainThread | [rest_client:set_data_path:2279] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2022-02-23 03:11:44,345 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:703] RAM quota was defined less than 100 MB: 2022-02-23 03:11:55,885 | test | INFO | MainThread | [basetestcase:initialize_cluster:494] Cluster C1 initialized 2022-02-23 03:11:55,887 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:11:55,917 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:12:08,812 | test | INFO | pool-3-thread-20 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+------+--------------+ | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 0.26 | Cluster node | | 172.23.136.160 | None | | | <--- IN --- | | 172.23.136.162 | None | | | <--- IN --- | | 172.23.136.158 | None | | | <--- IN --- | +----------------+----------+-----------------------+------+--------------+ 2022-02-23 03:12:08,841 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 03:12:23,897 | test | INFO | pool-3-thread-20 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 03:12:23,915 | test | INFO | pool-3-thread-20 | [task:check:474] Rebalance completed with progress: 100% in 15.1039998531 sec 2022-02-23 03:12:24,088 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 4.14649617734 | 5.99 GiB | 4.09 GiB | 2.07 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 4.845 | 5.99 GiB | 4.06 GiB | 2.08 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 0.26 | 5.99 GiB | 4.14 GiB | 2.00 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 0.362240213672 | 5.99 GiB | 4.17 GiB | 1.99 GiB / 7.62 GiB | 0 / 0 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 03:12:24,091 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:12:24,092 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup started for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:12:24,362 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1913] Creating required buckets from template 2022-02-23 03:13:14,579 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2527] Waiting for all collections to be created 2022-02-23 03:13:15,555 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 0 | 800.00 MiB | 263.47 MiB | 248.13 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 0 | 800.00 MiB | 262.51 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 0 | 5.86 GiB | 279.95 MiB | 209.08 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2022-02-23 03:13:15,558 | test | INFO | MainThread | [collections_base:collection_setup:168] Creating required SDK clients for client_pool 2022-02-23 03:13:26,322 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 03:13:26,351 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 03:13:41,812 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'default' +-------+------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................***X | 6868.000 | +-------+------------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 03:13:41,987 | test | INFO | pool-3-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket2' +-------+------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +-------+------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | **....................................................................................................***X | 56.300 | +-------+------------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 03:13:43,229 | test | INFO | pool-3-thread-27 | [table_view:display:72] Ops trend for bucket 'bucket1' +-------+-------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +-------+-------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | **...........................................****.........................................................X | 209.700 | +-------+-------------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:13:44,546 | test | INFO | pool-3-thread-3 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 31132.000 | ...................................................................................................X | 31132.000 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:13:44,611 | test | INFO | pool-3-thread-23 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 243.700 | ...................................................................................................X | 243.700 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:13:44,621 | test | INFO | pool-3-thread-14 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 209.700 | ...................................................................................................X | 209.700 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:13:44,947 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.136.160 | kv | 99.7101644648 | 5.99 GiB | 3.60 GiB | 2.64 GiB / 7.62 GiB | 96000 / 290000 | 7.1.0-2365-enterprise | | 172.23.136.156 | kv | 99.7128835175 | 5.99 GiB | 3.60 GiB | 2.67 GiB / 7.62 GiB | 96800 / 289200 | 7.1.0-2365-enterprise | | 172.23.136.162 | kv | 99.1147202716 | 5.99 GiB | 3.59 GiB | 2.67 GiB / 7.62 GiB | 17510 / 50024 | 7.1.0-2365-enterprise | | 172.23.136.158 | kv | 99.5826864974 | 5.99 GiB | 3.62 GiB | 2.66 GiB / 7.62 GiB | 17416 / 50459 | 7.1.0-2365-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2022-02-23 03:13:48,711 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 03:14:35,227 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 3000 | 800.00 MiB | 189.26 MiB | 402.83 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 3000 | 800.00 MiB | 291.86 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 380000 | 5.86 GiB | 539.82 MiB | 442.80 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 03:14:35,230 | test | INFO | MainThread | [basetestcase:log_setup_status:648] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_swap_rebalance ========= 2022-02-23 03:14:41,267 | test | INFO | MainThread | [collections_rebalance:setUp:60] Changing scrape interval to 5 2022-02-23 03:14:41,690 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 32} 2022-02-23 03:14:41,691 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1003] Doing collection data load before swap_rebalance 2022-02-23 03:14:41,694 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4993] Performing scope/collection specific operations 2022-02-23 03:14:47,431 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5083] Done Performing scope/collection specific operations 2022-02-23 03:14:47,582 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:361] Starting rebalance operation of type : swap_rebalance 2022-02-23 03:15:04,667 | test | INFO | pool-3-thread-10 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+ | Nodes | Services | Version | CPU | Status | +----------------+----------+-----------------------+----------------+--------------+ | 172.23.136.160 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.156 | kv | 7.1.0-2365-enterprise | 100 | Cluster node | | 172.23.136.152 | kv | 7.1.0-2365-enterprise | 0.416666666667 | Cluster node | | 172.23.136.162 | kv | 7.1.0-2365-enterprise | 94.8933333333 | --- OUT ---> | | 172.23.136.154 | kv | 7.1.0-2365-enterprise | 0.468333333333 | Cluster node | | 172.23.136.158 | kv | 7.1.0-2365-enterprise | 95.9898663289 | --- OUT ---> | +----------------+----------+-----------------------+----------------+--------------+ 2022-02-23 03:15:05,003 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 0.0 2022-02-23 03:15:06,378 | test | INFO | pool-3-thread-22 | [table_view:display:72] Ops trend for bucket 'default' +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ | 0.000 | **..............................................*......................................................X | 17792.200 | | 15133.600 | ....................................................................................X | 15133.600 | +-----------+----------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:15:07,713 | test | INFO | pool-3-thread-17 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 6214.000 | | 933.600 | ..............X | 933.600 | | 80.400 | *X | 80.400 | +---------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 03:15:07,829 | test | INFO | pool-3-thread-21 | [table_view:display:72] Ops trend for bucket 'bucket1' +----------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **....................................................................................................X | 5422.800 | | 1766.800 | ...............................*X | 1766.800 | | 116.400 | .X | 116.400 | +----------+---------------------------------------------------------------------------------------------------------+----------+ 2022-02-23 03:15:09,200 | test | INFO | pool-3-thread-16 | [table_view:display:72] Ops trend for bucket 'default' +-----------+------------------------------------------------------------------------------------------------------+-----------+ | Min | Trend | Max | +-----------+------------------------------------------------------------------------------------------------------+-----------+ | 15133.600 | ...................................................................................................X | 15133.600 | +-----------+------------------------------------------------------------------------------------------------------+-----------+ 2022-02-23 03:15:10,559 | test | INFO | pool-3-thread-4 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------+--------+ | 80.400 | ...................................................................................................X | 80.400 | | 16.800 | ...................X | 16.800 | +--------+------------------------------------------------------------------------------------------------------+--------+ 2022-02-23 03:15:10,648 | test | INFO | pool-3-thread-25 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------+---------+ | 116.400 | ...................................................................................................X | 116.400 | | 30.600 | .........................X | 30.600 | +---------+------------------------------------------------------------------------------------------------------+---------+ 2022-02-23 03:15:15,059 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 11.41 2022-02-23 03:15:25,107 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 03:15:35,151 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 33.33 2022-02-23 03:15:46,319 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 53.86 2022-02-23 03:15:56,365 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 66.67 2022-02-23 03:16:06,450 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 72.92 2022-02-23 03:16:16,503 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 90.76 2022-02-23 03:16:26,549 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: running, progress: 100.0 2022-02-23 03:16:41,657 | test | INFO | pool-3-thread-10 | [task:check:415] Rebalance - status: none, progress: 100 2022-02-23 03:16:41,756 | test | INFO | pool-3-thread-10 | [task:check:474] Rebalance completed with progress: 100% in 97.0900001526 sec 2022-02-23 03:16:41,983 | test | INFO | MainThread | [collections_rebalance:get_zone_info:969] nodes in zone inside get_zone_info():{'Group 1': ['172.23.136.154', '172.23.136.152', '172.23.136.156', '172.23.136.160']} 2022-02-23 03:16:45,671 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4742] Validating collection stats and item counts 2022-02-23 03:17:26,492 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 3 | none | 0 | 37618 | 800.00 MiB | 310.33 MiB | 327.18 MiB | 100 | | bucket2 | ephemeral | - | 3 | none | 0 | 36904 | 800.00 MiB | 362.97 MiB | 136.0 Byte | - | | default | couchbase | couchstore | 3 | none | 0 | 309072 | 5.86 GiB | 592.13 MiB | 451.07 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2022-02-23 03:17:26,493 | test | INFO | MainThread | [collections_rebalance:tearDown:86] Reverting prometheus settings back to default 2022-02-23 03:17:27,194 | test | INFO | MainThread | [cluster_ready_functions:set_rebalance_moves_per_nodes:156] Changed Rebalance settings: {u'rebalanceMovesPerNode': 4} 2022-02-23 03:17:27,651 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket2, Active Resident ratio(DGM): 100% 2022-02-23 03:17:27,651 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2022-02-23 03:17:37,384 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: bucket1, Active Resident ratio(DGM): 100% 2022-02-23 03:17:37,385 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2022-02-23 03:18:01,746 | test | INFO | MainThread | [collections_base:tearDown:84] Bucket: default, Active Resident ratio(DGM): 100% 2022-02-23 03:18:01,746 | test | INFO | MainThread | [collections_base:tearDown:87] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 466.758s OK During the test, Remote Connections: 193, Disconnections: 193 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 0 testrunner logs, diags and results are available under /data/workspace/temp_rebalance_magma_win/logs/testrunner-22-Feb-23_03-10-41/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 7m 58s 2 actionable tasks: 1 executed, 1 up-to-date [temp_rebalance_magma_win] $ /bin/sh -xe /tmp/jenkins8505372861416149562.sh Archiving artifacts Recording test results [description-setter] Description set: 1.1.8 -P client_version=3.1.6' Finished: SUCCESS